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ABSTRACT 


The  theory  of  automata  is  shown  not  capable  of  repre¬ 
senting  the  actual  physical  flow  of  information  in  the  so¬ 
lution  of  a  recursive  problem.  The  argument  proceeds  as 
follows : 

1.  We  assume  the  following  postulates:  a)  there  exists 
an  upper  bound  on  the  speed  of  signals;  b)  there  exists  an 
upper  bound  on  the  density  with  which  information  can  be 
stored. 


2.  Automata  of  fixed,  finite  size  can  recognize,  at  best, 
only  iteratively  defined  classes  of  input  sequences.  (See 
Kleene  (11)  and  Copi ,  Bigot,  and  Wright  (8).) 

3.  Recursively  defined  classes  of  input  sequences  that 
cannot  be  defined  iteratively  can  be  recognized  only  by 
automata  of  unbounded  size. 

4.  In  order  for  an  automaton  to  solve  a  (soluble) 
recursive  problem,  the  possibility  must  be  granted  that  it 
can  be  extended  unboundedly  in  whatever  way  might  be  required. 

5.  Automata  (as  actual  hardware)  formulated  in  accordance 
with  automata  theory  will,  after  a  finite  number  of  extensions, 
conflict  with  at  least  one  of  the  postulates  named  above. 
Suitable  conceptual  structures  for  an  exact  theory  of  communi¬ 
cation  are  then  discussed,  and  a  theory  of  communication  pro¬ 
posed. 

All  of  the  really  useful  results  of  automata  theory  may 
be  expressed  by  means  of  these  new  concepts.  Moreover,  the 
results  retain  their  usefulness  and  the  n ew  procedure  has 
definite  advantages  over  the  older  ones. 

The  proposed  representation  differs  from  each  of  the 
presently  known  theories  concerning  information  on  at  least 
one  of  the  following  essential  points: 

1.  The  existence  of  a  metric  is  assumed  for  neither  space 
nor  time  nor  for  other  physical  magnitudes. 

2.  Time  is  introduced  as  a  strictly  local  relation  between 
states. 


3.  The  objects  of  the  theory  are  discrete,  and  they  are 
combined  and  produced  only  by  means  of  strictly  finite  tech¬ 
niques. 
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|  The  following  conclusions  drawn  from  the  results  of  this 

,  work  may  be  cited  as  of  some  practical  interest: 

1 

1.  The  tolerance  requirements  for  the  response  character¬ 
istics  of  computer  components  can  be  substantially  weakened 
if  the  computer  is  suitably  structured. 

2.  It  is  possible  to  design  computers  structurally  in 
such  a  way  that  they  are  asynchronous,  all  parts  operating 
in  parallel,  and  can  be  extended  arbitrarily  without  inter¬ 
rupting  their  computation. 

3.  For  complicated  organizational  processes  of  any  given 
sort  the  theory  yields  a  means  of  representation  that  with 
equal  rigor  and  simplicity  accomplishes  more  than  the  theory 
of  synchronous  automata. 
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1.  Preliminaries 

THIS  WORK  is  concerned  with  the  conceptual  foundations  of  a  theory 
of  communication.  It  shall  be  the  task  of  this  theory  to  describe  in  a 

l 

consistent  and  exact  manner  as  many  as  possible  of  the  phenomena  that 
occur  in  the  transmission  and  transformation  of  information. 

Within  the  realm  of  scientific  thought  a  key  position  may  be  a - 
scribed  to  the  concept  of  communi cation.  It  is  therefore  necessary  to 
place  on  the  means  of  representation  and  proof  to  be  utilized  in  this 
theory  the  most  stringent  requirements  of  actual  constructibility.  How¬ 
ever,  there  are  two  immediate  applications  of  such  a  theory,  namely  in 
the  design  and  the  programming  of  information-processing  machines.  The 
conceptual  structures  of  the  theory  should  therefore  not  be  too  far  re¬ 
moved  from  those  currently  used  in  the  field,  which  have  of  course  had 
their  utility  demonstrated. 

The  representation  proposed  here  differs  from  the  presently  known 
theories  concerning  information  in  at  least  one  of  the  following  essen¬ 
tial  points: 

1.  The  existence  of  a  metric  is  assumed  for  neither 
space  nor  time  nor  for  other  physical  magnitudes. 

2.  Time  is  introduced  as  a  strictly  local  relation 
between  states. 

3.  The  objects  of  the  theory  are  discrete,  and  they 
are  conbined  and  produced  only  by  means  of  strict¬ 
ly  finite  techniques. 

The  basic  methodological  meaning  of  these  procedures  may  well  be 
of  little  interest  to  the  applied  scientist,  but  it  should  be  noted 
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that  this  work  was  begun  with  the  expressed  goal  of  eliminating  practi¬ 
cal  difficulties  and  that  this  goal  has  be  achieved  to  an  extent  to  be 
described  in  this  work. 

The  central  point  of  this  work  shall  be  to  discover  suitable  con¬ 
ceptual  structures  for  an  exact  theory  of  communication;  somewhat  less 
emphasis  will  be  placed  on  the  elaboration  of  this  theory  as  a  collection 
of  theorems.  However,  because  of  the  axiomatic  method  by  which  the  con¬ 
cepts  are  introduced  in  §4  there  is  a  ready  transition  to  such  areas  as 
formal  logic,  algebra,  and  topology,  and  the  theorems  of  these  fields 
may  find  interpretation  within  our  present  theory. 

The  following  conclusions  drawn  from  the  results  of  this  work  may 
be  cited  as  of  some  practical  interest: 

1.  The  tolerance  requirements  for  the  response  charact¬ 
eristics  of  computer  components  can  be  substantially 
weakened  if  the  computer  is  suitably  structured. 

2.  It  is  possible  to  design  computers  structurally  in 
such  a  way  that  they  are  asynchronous,  all  parts 
operating  in  parallel,  and  can  be  extended  arbitrar¬ 
ily  without  interrupting  their  computation. 

3.  For  complicated  organizational  processes  of  any 
given  sort  the  theory  yields  a  means  of  representa¬ 
tion  that  with  equal  rigor  and  simplicity  accomp¬ 
lishes  more  than  the  theory  of  synchronous  automata. 

It  should  not  be  expected,  however,  that  such  advantages  as  those 
cited  above  can  be  had  entirely  without  cost.  This  cost  lies,  however, 
not  in  a  high  degree  of  abstraction  that  would  infringe  on  applicability. 
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but  rather  in  requiring  of  the  user  a  certain  revaluation  of  concepts  as 
regards  their  simplicity.  Concepts  such  as  'time  interval’,  ’measurement', 
and  'state  of  a  system'  do  not  in  any  way  constitute  the  building  blocks 
of  the  theory.  Rather,  the  true  complexity  of  these  concepts  should  be 
described  —  'true'  in  respect  to  those  exact  relationships  of  communi¬ 
cation  that  admit  of  observation  and  control  and  are  attendant,  for  exam¬ 
ple,  to  the  process  'measurement  of  a  time  interval'. 

We  do  not  pose  the  question  of  which  concepts  are  actually  the  sim¬ 
plest;  only  the  successful  application  of  the  theory  to  be  built  on  the 
proposed  mathematical  model  will  be  required  as  justification  for  con¬ 
ceptual  framework  introduced  herein.  Nor  is  it  claimed  that  it  is  exact¬ 
ly  the  concepts  of  §4  and  only  those  that  would  bring  us  to  the  goal, 
nor  is  it  asserted  that  the  content  of  this  work  represents  a  formally 
closed  theory  admitting  of  no  further  discussion.  In  the  framework  of 
what  is  known  our  mode  of  procedure  might  be  described  as  follows:  the 
propagation  of  physical  effects  is  investigated  from  the  standpoint  of 
combinatorial  topology  and  is  interpreted  as  the  switching  logic  of  tot¬ 
ally  asynchronous  automata. 

2.  A  Critique  of  the  Theory  of  Automata 

The  theory  of  automata  has  produced  a  number  of  different  abstract 
models  of  information-processing  machines.  These  various  models  have  the 
following  features  in  common:  1)  one  proceeds  from  the  fiction  that  it  is 
at  all  times  meaningful  to  speak  of  the  total  state  Z  of  a  system  S  at  a 
time  t.  2)  A  process  in  S  can  then  be  described  by  means  of  a  function  f 
such  that  Z  =  /(t) .  3}  The  domain  over  which  f  is  defined  is  the  set  of 
real  numbers  or  a  subset  thereof.  Classical  physics,  too,  takes  the  above 
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outlook,  and  it  was  only  later,  as  a  result  of  the  theory  of  relativity, 
that  the  utility  of  this  approach  was  questioned. 

Thus,  to  drop  the  above-described  fiction  and  to  use  something  else 
as  the  basis  of  our  approach  is  to  depart  considerably  from  the  estab¬ 
lished  mode  of  thought.  It  therefore  seems  necessary  a)  to  show  the 
limitations  that  this  fiction  imposes  on  the  abstract  model;  b)  to  show 
that  all  of  the  really  useful  results  of  automata  theory  may  be  expressed 
quite  effortlessly  by  means  of  new  concepts  to  be  introduced  herein  and 
that  the  results  therewith  retain  their  usefulness;  and  finally  c)  to 
show  that  the  new  procedure  has  definite  advantages  over  the  older  ones. 

We  shall  begin  by  illustrating  the  difficulties  that  have  arisen 
when  the  abstract  models  of  automata  theory  are  confronted  with  reality. 
We  shall  argue  the  following  points: 

1.  We  assume  the  following  postulates:  a)  there 
exists  an  upper  bound  on  the  speed  of  signals ; 
b)  there  exists  an  upper  bound  on  the  density 
with  which  information  can  be  stored. 

2.  Automata  of  fixed,  finite  size  can  recognize, 
at  best,  only  iteratively  defined  classes  of 
input  sequences.  (See  Kleene  [11]  and  Copi, 

Elgot,  and  Wright  [8].)  ' 

3.  Recursively  defined  classes  of  input  sequences 
that  cannot  be  defined  iteratively  can  be  re¬ 
cognized  only  by  automata  of  unbounded  size. 

4.  In  order  for  an  automaton  to  solve  a  (soluble) 
recursive  problem,  the  possibility  must  be 
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granted  that  it  can  be  extended  unboundedly 
in  whatever  .  ay  might  be  required. 

5.  Automata  (as  actual  hardware)  formulated  in 
accordance  with  automata  theory  will* after  a 
finite  number  of  extensions,  conflict  with  at 
least  one  of  the  postulates  named  above. 

In  short:  the  theory  of  automata  is  not  capable  of  representing  the 
actual  physical  flow  of  information  in  the  solution  of  a  recursive 
problem. 

In  order  to  clarify  the  goal  of  our  considerations,  let  us  examine 
our  arguments  in  terms  of  the  practices  attendant  to  computer  construc¬ 
tion,  before  we  actually  proceed  with  the  execution  of  these  arguments. 

The  logical  plan  of  a  computer  specifies  a  finite  number  of  states 
that  the  computer  must  assume  at  particular  points  in  time  or  within 
particular  time  intervals.  To  these  logical  states  there  must  correspond 
physically  distinguishable  states  of  the  computer;  these  machine  states 
may  be  regarded  as  belonging  to  the  cells  of  a  phase  space.  We  shall  now 
attempt  to  solve  a  recursive  problem  on  such  a  machine.  We  can  predict 
nothing  regarding  the  storage  that  the  machine  will  require  for  the 
solution  of  the  problem.  We  either  reach  a  solution  or  come  to  a  stage 
in  the  solving  at  which  the  machine  signals  of  a  further  storage  re¬ 
quirement.  Assuming  that  we  do  not  wish  to  halt  the  process  and  forego 
all  the  benefits  of  the  uncompleted  attempt  at  solution,  there  are  two 
possible  courses  of  action. 

The  first  alternative  would  be  to  bring  about  an  output  of  the  in¬ 
formation  onto  some  external  storage  medium,  with  the  possibility  of  re- 


loading  the  machine.  We  then  manipulate  this  storage  medium  in  such  a 
way  that,  relative  to  the  machine,  it  will  constitute  an  external  memory. 
However,  in  that  case  the  machine  itself  solves  only  a  trivial,  at  best 
iterative  portion  of  the  recursive  problem. 

The  second  alternative  would  be  to  construct  a  second  machine,  one 
that  would  either  substitute  for  our  manipulation  of  the  data  (by  in¬ 
creased  storage)  or  would  carry  out  this  manipulation  for  us.  If  this 
machine  is  in  turn  described  by  a  logical  plan,  then  this  extension  may 
be  viewed  as  the  addition  of  finitely  many  cells  to  the  phase  space. 

There  now  arises  the  problem  of  coordinating  the  action  of  the  two  mach¬ 
ines.  In  general,  however,  this  coordination  cannot  be  effected  without 
a  modification  or  rebuilding  of  the  original  machine,  for  if  we  assume 
that  the  temporal  separation  of  the  states  is  defined  by  an  oscillator 
with  a  certain  base  frequency,  then  the  signal  transmission  times  possi¬ 
ble  after  the  extension  of  the  machine  may  exceed  the  basic  period  of 
the  oscillator;  in  any  case,  the  basic  period  will  be  exceeded  after 
some  finite  number  of  extensions.  We  must  therefore  lower  the  base  fre¬ 
quency,  and  after  some  finite  number  of  frequency  reductions  the  metric 
properties  of  the  components  will  have  to  be  changed  to  fit  the  new  base 
frequency.  (For  those  sorts  of  coupling  for  which  no  upper  bound  on  the 
frequency  is  prescribed,  the  modifications  of  the  components  are  re¬ 
quired  in  order  that  the  number  of  misfunctions  per  cycle  be  held  within 
certain  bounds.] 

An  analogue  to  these  conditions  is  provided  by  the  addressing  of 
a  computer  memory  having  fixed  word  length:  with  regard  to  addressing,  a 
computer  memory  is  not  unboundedly  extensible,  for  after  a  certain  finite 
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number  of  extensions  we  come  to  a  point  at  which  the  information  re¬ 
quired  to  designate  a  memory  cell  cannot  be  contained  within  one  com¬ 
puter  word.  We  must  then  use  other  means  of  attacking  the  problem  or  in¬ 
crease  the  word  length  and,  thereby,  fundamentally  alter  the  structure 
of  the  memory. 

We  shall  treat  these  difficulties  as  a  problem  of  the  logical 
structure  of  communication,  with  the  aim  of  generalizing  the  form  of 
communication  in  such  a  way  that  these  difficulties  will  disappear. 

We  shall  now  pursue  the  individual  points  of  the  argumentation 
sketched  above. 


Point  1.  We  shall  forego  any  attempt  to  use  simpler  assumptions  to 
derive  the  existence  of  an  upper  bound  on  signal  transmission  speed  or 
on  information  density;  we  shall  therefore  introduce  postulates  regard¬ 
ing  these  bounds.  It  must  be  admitted  that  this  argumentation  becomes 
untenable  if  a  means  is  found  by  which  signal  transmission  speed  and  in¬ 
formation  density  might  be  increased  without  limit.  By  way  of  an  explan¬ 
ation,  then,  let  it  be  added  tnat  we  regard  the  speed  of  light  as  an  up¬ 
per  bound  for  signal  transmission  speed.  The  second  postulate  serves  to 
express  the  impossibility  of  constructing  a  physical  object  of  finite 


volume  that  could  be  used  as  a  memory  for  arbitrarily  large  amounts  of 
information.  This  postulate  gains  some  plausibility,  perhaps,  if  we  as¬ 
sociate  it  with  the  quantum  postulate. 

If  we  designate  the  stored  information  by  means  of  the  impulse  co¬ 
ordinates  of  a  specified  set  of  material  particles,  for  example,  then 
the  amount  of  information  to  be  stored  will  prescribe  a  certain  exact¬ 
ness  for  the  measurement. of  the  impulse  coordinates.  As  the  amount  of 
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information  increases  the  impulse  coordinates  must  be  specified  more  and 
more  exactly,  but  according  to  the  quantum  principle  the  inexactness  of 
the  positional  coordinates  will  increase  beyond  all  bounds.  Therefore, 
the  spatial  domain  in  which  the  information  is  to  be  protected  from  dis¬ 
turbance,  i.  e.  the  volume  of  the  memory,  will  have  to  be  increased  be¬ 
yond  all  bounds. 

Point  2.  Initially  we  shall  speak  only  of  deterministic,  synchron¬ 
ous,  digital  automata.  For  such  automata  one  proceeds  from  the  assumption 
that  they  enter  well-defined  states  at  specific  times  where  i  e  {*•• 
-2,  -1,  0,  1,  2,  •••};  the  state  at  time  ^  output  signal  at 
time  t.  are  single-valued  functions  of  the  state  and  the  input  signal 
at  time  t..  The  domain  of  values  of  the  input  and  output  signals  is  as- 
sumed  to  be  finite.  If  the  set  of  possible  states  that  the  automaton  can 
assume  is  specified  and  finite,  then  we  speak  of  a  finite  automaton. 

Automata  may  now  be  characterized  in  several  ways  (v.  Lee  [11]) : 

a)  by  specifying  the  connection  between  the  states  and 

the  signals  at  times  £.  and  t.,,  for  all  i; 

v  z+1 

b)  by  writing  a  program  to  simulate  the  automaton; 

c)  by  specifying  the  structure  of  the  composition  from 
idealized  components  of  the  automaton; 

d)  by  specifying  a  mapping  of  the  input-signal 
sequences  onto  the  output-signal  sequences. 

For  our  purposes,  the  last-named  method  of  characterization,  especially, 
is  essential.  We  may  ask  ourselves  what  properties  of  an  input  sequence 
can  be  recognized  by  an  automaton,  wherein  a  property  is  said  to  be  re¬ 
cognizable  if  it  can  be  uniquely  brought  into  correspondence  with  some 
property  of  individual  output  sequences  in  a  manner  to  be  shown  below. 


Let  X  »  (a,  b,  e,  •••}  be  the  finite  set  of  input  signals,  and  let 
X  =  (o,  $,  Y,***)  be  the  finite  set  of  output  signals;  let  t tX  be  the  set 
of  all  subsets  of  X  (including  9  and  X) .  The  subsets  of  X,  that  is,  the 
elements  of  tlX ,  characterize  all  possible  properties  of  individual  out¬ 
put  signals.  For  example,  the  subset  {a,  0}  designates  the  property  (of 
a  signal)  of  being  either  o  or  B.  These  properties  form  a  boolean  ring. 

We  now  wish  to  characterize  the  properties  of  input  sequences.  In 
line  with  our  task  of  investigating  communication  relationships,  we  shall 
view  the  input  sequences  as  messages  to  the  automaton.  Since  UX  contains 
only  finitely  many  elements,  the  automaton  can  recognize  at  most  the 
same  number  of  properties. 

The  set  of  messages  to  the  automaton  forms,  with  respect  to  con¬ 
catenation,  a  free  semigroup  with  identity  with  the  set  X  of  generators, 
which  set  we  wish  to  view  as  the  alphabet  of  a  formal  language.  Since  we 
can  consider  only  the  formal  properties  of  messages,  we  define  the  ex¬ 
pressions  in  this  language  purely  by  means  of  syntax.  For  the  represent¬ 
ation  of  the  syntax,  we  make  use  of  a  formal  metalanguage  the  alphabet 
of  which  contains  all  the  elements  of  JSf,  that  is  a,  b,  <?,•••,  and,  in 
addition  to  these,  the  symbols  V,  /,  and  (J. 

An  expression  in  the  metalanguage  designates  a  set  of  input  sequen¬ 
ces.  This  metalanguage  is  chosen  in  such  a  way  that  its  own  expressions 
belong  to  a  very  simple  syntax,  namely  that  of  a  simple  phrase  structure 
grammar  (see  Chomsky  [7]),  or,  more  generally,  so  that  the  expressions 
are  the  formulas  of  a  veiy  simple  combinatorial  system  (see  Post  [19]). 

In  the  definition  of  a  combinatorial  system  we  follow  Davis  [10] 

(our  paraphrasis  or  undesignated  quotation  being  derived  from  material 
on  pages  83ff.  of  [10]):  A  word  is  a  finite,  possibly  empty,  sequence  of 
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J  symbols.  A  production  is  a  two-place  predicate  between  words  and  is  de- 

v  signated  by  an  ordered  sextuple  of  words  gt  ht  k\  g%  h%  k.  For  a  given 

ordered  pair  of  words  F  and  Gt  the  predicate  is  true  if  and  only  if 
there  exists  words  P  and  Q  such  that 

F  =  g  P  h  Q  k  and  G  =  g  P  Ti  Q  H, 

We  shall  then  say  that  G  is  a  consequence  of  F  with  respect  to  the  pro¬ 
duction .  A  combinatorial  system  V  consists  of  a  single  non-empty  word 

called  the  axiom  of  T  and  a  finite  set  of  productions  called  the  produc - 

/  ■ 

tions  of  r.  Hie  alphabet  of  r  consists  of  all  symbols  that  occur  either 
in  the  axiom  of  r  or  in  the  g,  ht  kt  gt  K,  k  that  define  the  productions 
of  T.  A  proof  (or  derivation)  in  a  combinatorial  system  r  is  a  finite 
sequence  of  words  Fj3  F^3  ...  F^  such  that  F ^  is  the  axiom  of  r  and  such 
that  for  all  i  (1  <  i  <  m)  t  F^  is  a  consequent  of  F^  ^  with  respect  to 
the  productions  of  r.  A  word  is  a  theorem  in  T  if  it  is  the  final  step 
of  a  proof  in  T.  A  formula  in  r  is  a  theorem  that  has  no  consequent  with 
respect  to  the  productions  of  r. 

To  return  now  to  the  discussion  of  our  metalanguage  —  our  expres¬ 
sions  for  the  description  of  input  sequences  are  to  be  fonnulas  in  the 
following  combinatorial  system  CS1: 

Axiom:  Z 

Productions:  gt  k,  gt  k  are  empty 
h  =  Z. 

The  productions  differ  then  only  in  Ti ,  and  finding  a  consequent  consists 
in  carrying  out  the  substitution  Z  -*■  h.  Accordingly,  we  shall  describe 
our  productions  as  follows: 


E  +  VIZ 
E  *  /  Z  Z 
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Z 

Z 


enumeration  of  the  elements  of  X. 


To  each  formula  of  this  system  we  shall  assign  a  set  of  sequences 

of  ^-elements  (i.  e.  of  input  signals)  according  to  the  following  rules: 

0  designates  the  empty  set  (signal) , 

a  designates  the  set  containing  the 
sequence  ’a'  of  length  1, 
b  correspondingly,  . 

V  Z  Z  designates  the  union  of  two  sets  each  de¬ 
rived  from  a  Z-symbol  by  substitution, 

/  Z  Z  designates  the  set  of  those  sequences  of  length  £,  where 
l  -  lx  +  l2  (£i  >  0,  Zz>  0)  such  that  the  first  t\  ele¬ 
ments  of  the  sequence  constitute  a  sequence  belonging  to  the 
set  assigned  to  the  (partial)  formula  derived  from  the 
first  Z-symbol  by  substitution,  and  similarly,  such  that 
the  last  Lz  elements  of  the  sequence  constitute  a  sequence 
belonging  to  the  set  assigned  to  the  (partial)  formula  de¬ 
rived  by  substitution  from  the  second  Z-6ymbol, 

X  Z  designates  the  set  of  exactly  those  sequences  for  which 
there  exists  a  positive  integer  n  ^  0,  such  that  the  se¬ 
quence  can  be  partitioned  into  n  partial  sequences  each 
of  which  belongs  to  the  set  assigned  to  the  partial 
formula  derived  by  substitution  from  the  Z-symbol. 

In  accordance  with  the  above  we  designate  V  as  the  selection  operator, 

/  as  the  sequence  operator ,  and  ¥:  as  the  iteration  operator . 

We  now  give  two  theorems,  T1  and  its  converse,  T2. 

Theorem  T2:  For  every  finite  set  of  finite  formulas  of  the  combinatori¬ 
al  system  CS1  there  may  be  specified  a  finite,  digital,  de~ 
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terministic,  synchronous  automaton  such  that  to  each  form¬ 
ula  of  the  set  there  corresponds  a  property  of  the  input 
sequences  recognizable  by  the  automaton. 

Theorem  Tl:  All  properties  of  the  input  sequences  recognizable  by  a  giv¬ 
en  finite,  digital,  deterministic,  synchronous  automaton  are 
specified  by  a  finite  set  of  finite  formulas  of  the  combin¬ 
atorial  system  CS1. 

These  theorems  derive  their  significance  primarily  from  the  defin¬ 
ition  of  recognizability y  which  we  shall  now  state  and  discuss. 

Def:  A  property  P  of  an  input  sequence  is  recognized  by  an  auto¬ 
maton  if  there  exists  a  property  Q  of  individual  output 
signals  such  that  the  output  signal  has  the  property  Q  at 
time  t  if  and  only  if  the  input  sequence  whose  last  symbol 
appears  at  time  t  has  the  property  P. 

The  usefulness  of  this  definition  should  be  elucidated  briefly.  We 
must  regard  the  properties  of  individual  input  signals  as  distinguishable 
in  all  cases,  and  therefore,  colloquially  speaking,  as  recognizable.  This 
is  inherent  in  the  nature  of  digital  signals.  Beyond  this  we  are  inter¬ 
ested  in  the  properties  of  sequences  of  such  input  signals,  for  example 
the  property  of  containing  only  the  signals  a  and/or  b,  which  would  be 
designated  by  #Vab.  Such  properties  could  be  mapped  onto  properties  of 
output  signals  (see  [3],  [8],  [16],  and  [IS]);  in  contrast  to  this,  how¬ 
ever,  we  are  concerned  with  exactly  those  properties  that  are  expressed 
in  individual  output  signals  (generalized  after  [11]  and  [8]).  In  the 
case  of  deterministic  automata,  it  is  obviously  possible  to  reconstruct 
the  properties  of  the  output  sequences  from  the  properties  of  the  input 
sequences,  but  such  reconstruction  is  of  no  interest  here  since  it  does 
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not  contribute  to  the  characterization  of  the  automaton. 

We  have  regarded  the  set  of  possible  output  signals  as  specified  in 
advance.  One  might  ask,  however,  whether  there  perhaps  exist  internal 
signals  not  belonging  to  the  set  of  output  signals  but  yet  capable  of 
distinguishing  even  those  input  properties  that  are  not  distinguished  by 
the  output  signals.  It  would  then  be  questionable  whether  such  properties 
should  be  regarded  as  recognized  (or  recognizable) .  We  free  ourselves  of 
this  dilemma  by  stipulating  that  the  output  signal  at  time  t  be  the  or¬ 
dered  p- tuple  of  all  p  observable  elementary  signals  in  the  automaton  at 
time  t.  In  any  particular  instance,  then,  it  must  be  established  in  ad¬ 
vance  which  elementary  signals  are  to  be  considered  observable.  With  this 
stipulation  the  theorems  become  applicable  both  to  automata  conceived  of 
as  black  boxes  as  well  as  to  automata  with  a  physical- structural  type 
of  characterization. 

For  a  proof  of  theorem  T2  we  may  refer  to  the  work  of  Copi,  Elgot, 
and  Wright  [8] ,  in  which  there  is  given  an  algorithm  for  the  synthesis 
of  logical  nets  that  fulfill  the  requirements  of  the  theorem.  (Following 
a  usage  that  is  of  some  advantage  if  the  formulas  serve  only  an  explan¬ 
atory  function,  those  authors  use  the  following  productions  in  a  com¬ 
pletely  equivalent  manner: 

I  +  (Z  V  I)  instead  of  E  7  IE 
Z  (2  •  2)  "  E  +  /EE 

E+I*  "  E  ■*>  *  2 

2  -  A  ”  1*9  .) 

The  authors  utilize  elements  for  conjunction,  disjunction,  negation,  and 
time  delay  in  the  ’construction’  of  logical  nets.  As  properties  of  the 
output  signals  only  the  values  of  the  elementary  signals  are  required. 


1 

—  14— 

I 

From  this  characterization  of  an  automaton  as  a  logical  net,  one  can  with 
no  further  difficulty  make  the  transition  to  other  representations,  for 
example  to  that  of  state  graphs. 

Copi,  Elgot,  and  Wright  likewise  supply  the  proof  of  theorem  T1  in 
all  its  essentials  (see  [8]  p.  187)  and  only  a  couple  supplementary  re — 
marks  are  required  to  justify  the  theorem  in  the  form  used  here. 

There  is  no  loss  of  generality  in  assuming  the  range  of  values  of 

the  elementary  signals  to  be  the  set  (0,  1}.  For  deciding  whether  a  given 

signal  has  a  particular  property,  a  signal  of  this  range  is  sufficient; 

conversely  it  is  well  known  that  a  signal  of  the  greater  range  {a^,  a 

a^, ...,  an }  can  be  represented  by  a  fc-tuple  of  binary  elementary  signals, 
v 

where  2  in.  We  can  suppose  that  k  =  n  and  that  the  binary  encoding  of 
the  input  signals  is  continued  throughout  the  entire  automaton.  Further, 
there  is  no  loss  of  generality  caused  by  the  authors’  treatment  of  only 
those  automata  that  are  characterized  by  the  way(s)  in  which  their  ele¬ 
mentary  switching  elements  are  conbined.  If,  instead,  the  finite  state 
graph  of  the  automaton  is  given,  then  there  can  always  be  constructed  a 
switching  circuit  equivalent  to  the  state  graph.  Even  beyond  this,  Mc- 
Naughton  and  Yamada  state  algorithms  permitting  the  formulas  (regular  ex¬ 
pressions)  of  the  output  signals  to  be  found  directly  from  the  state 
graphs  (and  conversely) (see  [14]). 

Finally,  we  speak  more  generally  of  properties  of  an  output  signal, 
whereas  Copi,  Elgot,  and  Wright  treat  only  the  binary  properties  (i.  e. 
the  values  at  time  t)  of  the  individual  elementary  signals  at  the  output. 
The  theorem  has,  of  course,  nothing  to  do  with  special  coding,  and  we 
put  forth  our  generalization  in  order  that  it  be  independent  of  the  en¬ 
coding  of  signals  in  its  wording  as  well.  Consequently,  our  theorem  T1 


? 
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becomes  somewhat  stronger,  and  our  theorem  12  somewhat  weaker,  than  the 
corresponding  theorems  of  Copi,  Elgot  and  Wright.  Our  theorem  T1  there¬ 
fore  requires  an  additional  step  of  proof,  whereas  for  T2  we  need  only 
note  that,  by  means  of  the  above-mentioned  synthesis  algorithm,  the  pro¬ 
perties  to  be  recognized  are  in  fact  already  expressed  by  means  of  the 
binary  elementary  signals.  The  required  additional  step  of  proof  reads: 

To  prove:  Every  subset  of  the  set  of  output  signals  can  be 
represented  bv  a  CS-1  formula  if  every  output 
signal  is  represented  by  such  a  formula: 

Proof:  As  was  mentioned  above,  the  subsets  form  a  boolean 

ring  of  2  elements  with  the  k  generators  a,  S,*“. 
Let  0  be  the  formula  representing  the  empty  subset, 
and  let  Fq,  Fg,...  be  the  representations  of  a,  B, 

....  We  assume  the  assertion  to  be  true  for  all  sub¬ 
sets  of  g  <  h  elements;  now  if  H  is  a  subset  with  h 
elements  and  F ^  its  representation,  then  the  repre¬ 
sentation  Fj  of  a  subset  J  of  h+1  elements,  such 
that  J  D  Ht  is  given  by  the  formula  Fj  «  VF^F^,  where 
F^  is  the  additional  element  of  J  not  in  #.  However, 
this  is  again  a  formula  of  the  ccnbinatorial  system, 
and  since  every  subset  is  finite,  containing  at  most 
k  elements,  the  formula  representing  any-  given  sub¬ 
set  is  also  finite. 

We  may  now  say  that  an  automaton  of  the  type  considered  can  receive 
arbitrary  input  sequences  containing  messages  in  some  formal  language  and 
that  it  can  evaluate  such  messagej,  that  is  to  say,  can  produce  an  effect 
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well-defined  with  respect  to  manner  and  time,  however,  only  insofar  as 
the  syntax  of  the  formal  language  is  expressible  by  means  of  formulas  of 
the  system  CS1. 

Such  a  syntax  as  is  expressible  by  a  finite  set  of  CS1  formulas  we 
shall  refer  to  as  an  iterative  syntax ,  fc  ■  it  is  primarily  X-,  the  itera¬ 
tion  operator,  that  defines  the  power  of  such  a  system.  For  if  an  auto¬ 
maton  has  but  one  state  and  is  therefore  equivalent  to  a  closed  circuit, 
then  it  can  recognize  only  individual  input  signals:  the  syntax  of  any 
of  the  possible  input  languages  is  'contained*  in  CS1,  and  only  the  V 
operator  is  required.  If  the  automaton  contains  delay  elements  then  also 
the  operator  /  is  required,  and,  finally,  to  express  the  feedback  of  sig¬ 
nals,  the  operator  X  is  required. 

For  the  sake  of  brevity  we  shall  also  speak  of  iterative  messages 
in  iterative  languages ,  i.  e.  messages  in  languages  expressed  in  an  iter¬ 
ative  syntax  (as  defined  above).  Further,  by  an  iterative  problem  we 
shall  mean  a  problem  the  treatment  of  which  consists  in  considering  as 
the  input  sequence  to  an  automaton  some  arbitrary  symbol  sequence  (the 
problem  statement)  recognized  according  to  an  iterative  syntax;  the  sol¬ 
ution  to  such  a  problem  will  comprise  the  sequence  of  recognitions,  i.  e. 
the  output  sequence. 

A  syntax  that  cannot  be  specified  (expressed)  by  a  finite  number  of 
CS1  formulas  we  shall  call  irregular.  Irregular  syntax  is  encountered, 
for  example,  in  any  language  in  which  brackets  (in  their  usual  meaning) 
are  admitted  without  limit,  as  in  most  mathematical  formula  languages, 
for  example.  Further,  the  syntax  of  ALGOL  as  well  as  of  natural  languages 
is  irregular.  The  interest  in  irregular  languages  in  connexion  with  auto¬ 
mata  derives  primarily  from  the  necessity  of  solving  recursive  problems 
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(insofar  as  such  problems  can  be  solved  with  the  aid  of  a  Turing  machine). 
It  might  be  mentioned,  however,  that  the  concept  of  conflict  to  be  intro¬ 
duced  below  (Part  4)  allows  for  the  treatment  of  a  yet  more  general  class 
of  irregular  problems. 

It  is  felt,  then,  that  the  second  point  of  our  argument  has  been 
elucidated  sufficiently:  Automata  of  fixed,  finite  size  can  recognize, 
at  best,  only  iteratively  defined  classes  of  input  sequences. 

Point  3.  We  shall  now  prove  our  third  assertion,  namely  that  recurs¬ 
ively  defined  classes  of  input  sequences  that  cannot  be  defined  iterat¬ 
ively  can  be  recognized  only  by  automata  of  unbounded  size,  by  showing 
that  with  even  a  slight  extension  of  the  combinatorial  system  that  served 
to  characterize  the  languages  for  finite  automata,  an  automaton  of  fixed, 
finite  size  will  not  suffice  for  deciding  whether  a  given  message  is  a 
member  of  a  given  set,  although  a  Turing  machine  (with  its  tape)  would 
be  adequate.  We  shall  imagine  this  tape  as  consisting  initially  of  but 
one  square,  with  the  condition  that  any  displacement  (of  the  tape)  that 
would  result  in  there  being  no  existent  square  under  the  reading  head 
will  cause  a  square  (always  with  the  same  initial  symbol)  to  be  produced 
under  the  reading  head.  The  size  of  this  machine  together  with  its  tape 
is  then  unbounded. 

We  wish,  first  of  all,  to  elucidate  the  expression  recursive  mess¬ 
age ;  by  this  term  is  meant,  then,  a  message  in  a  language  with  a  recurs¬ 
ive  syntax ,  that  is,  in  a  recursive  language .  We  shall  call  a  syntax  re¬ 
cursive  if  it  contains  a  recursion  operator ,  which  will  be  defined  direct¬ 
ly.  Such  a  syntax  may  be  generated  by  the  combinatorial  system  CS2  as 


follows: 
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Axiom:  E 


Productions;  Z  -*•  V  Z  E 
E+/II 
Z  +  R 
E 

2  -*■  2?  V  enumeration  of  the  elements  of  £ 


We  shall  now  give  an  interpretation  to  the  formulas  in  CS2.  To  each 
formula  of  the  system  there  is  assigned  a  set  of  sequences  of  X-elements 
in  the  following  manner: 


a 

b 

V  E  E 
/EE 


exactly  as  in  CS1 


We  shall  give  a  constructive  interpretation  for  the  R  operator  by  con¬ 
sidering  a  Turing  machine  with  the  possibility  of  input  and  output;  this 
machine  is  to  be  capable  of  producing  on  its  tape  every  element  of  the 
set  of  signal  sequences;  this  it  does  by  working  through  the  formula 
specified  on  its  tape  initially  and,  in  the  event  of  choice,  by  requir¬ 
ing  of  its  environment  (that  is,  of  some  external  source)  the  information 
necessary  for  reference  to  a  definite  element.  This  input  will  be  in  the 
form  of  a  sequence  of  0’s  and  I's.  (The  same  sort  of  procedure  could  be 
applied  in  a  simpler  manner  to  the  formulas  of  CS1.)  By  means  of  this 
procedure  we  also  obtain  a  mapping  between  the  sequences  of  0's  and  l’s, 
which  correspond  to  the  successive  choice  points  associated  with  a  given 
formula,  and  the  sentences  of  a  recursive  language.  It  should  be  noted 
that'  the  significance  of  this  mapping  lies  deeper  than  the  mere  possibil¬ 
ity  of  encoding  the  individual  sysfcols  of  the  languages  with  0*s  and  l's. 


-19- 


The  machine  reads  the  formula  from  left  to  right  and  proceeds  as 
follows:  initially  the  tape  is  to  contain  the  formula  and,  behind  the 
formula,  the  bracket  pair  []  (for  the  reception  of  the  generated  sequence). 
The  machine  is  now  ready  to  interpret  the  first  symbol  of  the  formula. 


Synbol 

Interpreted 


Operation 


/  None  (interpret  next  synbol  to  the  right) 


a  \  The  synbol  under  consideration  replaces 
b  (  3  and  }  is  placed  behind  it;  the  synbol 
l  \  token  interpreted  remains  unchanged. 


V  The  machine  interrogates  the  environment 

as  to  whether  a  recursion  step  is  to  be 
executed.  (Reply  0  =  no,  1  =  yes)  If  a 
no  reply  is  received,  the  machine  inter¬ 
prets  the  next  partial  formula  and  skips 
over  the  partial  formula  following  that 
one.  On  receipt  of  a  yes  reply  from  the 
environment,  the  machine  skips  over  the 
next  partial  formula  and  treats  the  par¬ 
tial  formula  following  that  one. 

R  This  token  is  replaced  by  the  shortest 

V-partial  formula  in  whose  second  sub- 
partial  formula  it  (this  R)  appears. 

The  interpreting  is  then  continued  with 
the  first  synbol  of  the  sub-partial 
formula  that  has  been  inserted. 

The  attempt  to  interpret  the  bracket  [  either  ends  the  interpreting  or 
enables  the  contents  of  the  []  to  be  released  as  output.  If,  in  the  in¬ 
terpretation  of  R,  no  shortest  V-partial  formula  is  found,  or  if  some 
particular  recursion  step  is  required  indefinitely,  then  the  intexpreta- 
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tion  procedure  comes  to  no  conclusion  and  no  output  is  produced.  Hie  in- 
teipretation  of  R  is  thus  a  generalization  leading  to  the  same  effect  as 
the  interpretation  of  0  in  CS1. 

Furthermore,  all  sets  of  sequences  representable  in  CS1  can  be  re¬ 
presented  in  CS2,  for  the  set  produced  by  7  Z  Z  in  CS1  is  of  course  ex¬ 
actly  the  set  produced  by  V  Z  Z  in  CS2,  if  no  R  or  0  is  encountered  in 
the  evaluation  of  the  expression.  Further,  the  CS1  formula  X  Z  can  be 
expressed  in  CS2  by  means  of  the  formula  V  Z  /  Z  R. 

We  shall  not  consider  the  programming  details  of  the  interpretation 
process;  we  shall  mention  only  that  additionally  a  bounded  set  of  symbol 
forms  or  tapes  should  be  available,  with  which  it  is  possible  to  mark 
the  location  of  observed  symbols  and  of  partial  formulas  to  be  skipped 
or  recognized.  The  recognition  of  partial  formulas  can  be  effected  in  a 
simple  manner  by  counting:  let  a  counter  be  set  to  • 1 •  and  let  a  mark  be 
placed  before  the  string  to  be  tested.  For  V  or  /  let  the  counter  add 
'+1!  to  its  contents,  for  R,  a,  b,...  let  ’-l'  be  added.  As  soon  as  the 
counter  shows  'O’  let  an  additional  mark  be  placed  behind  the  observed 
symbol.  By  this  means,  the  (unique)  partial  formula  beginning  at  (that 
is,  just  after)  the  first  mark  is  delimited.  For  each  symbol  of  a  formula 
there  begins  a  partial  formula  with  that  symbol  as  its  beginning.  These 
delimiting  marks  are  not  copied  during  the  insertion  of  a  formula. 

It  is  now  easily  recognizable  that  there  exist  recursive  languages 
that  are  irregular.  This  may  be  elucidated  by  a  simple  example;  let  us 
consider  a  sequence  set  containing  the  following  elements: 

0 

101 

11011 

1110111 

111101111  et  cetera. 
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If  we  were  able  to  specify  exactly  this  set  by  means  of  a  (finite)  CS1 
formula,  then  we  could  also  specify  a  finite  switching  network  that  would 
recognize  whether  a  sequence  had  the  property  of  belonging  to  this  set 
and  would  therefore  produce  an  output  signal  at  time  t  with  some  particul¬ 
ar  property  if  and  only  if  the  input  sequence  upto  time  t  belonged  to  the 
set.  We  now  consider  the  switching  network  at  that  point  of  time  at  which 
the  first  0  appears  at  the  input;  at  this  point  of  time  it  is  established 
which  element  of  the  set  can  stand  at  the  beginning  of  the  input  sequence. 
The  subsequent  activity  of  the  switching  network  must  be  different  for 
each  element  of  the  set,  and,  therefore,  at  the  appearance  of  the  first 
0,  the  network  must  be  in  a  different  state  for  each  element  of  the  set. 
However,  since  the  network  is  capable  of  only  a  certain  finite  number  of 
states,  this  is  impossible. 

On  the  other  hand,  this  set  can  be  produced  by  the  CS2  formula 

FI:  V0//1R1 

and  it  is  clear  that  there  exists  a  Turing  machine  that  recognizes  this 
set  (see  Davis  [10]) . 

If  we  examine  the  following  formula  from  CS1, 

/  /  *  1  0  *  1 

then  it  can  be  seen  that  although  this  formula  does  indeed  produce  a 
proper  'superset*  of  the  set  of  sequences  generated  by  V  0  /  /  1  R  1,  it 
nevertheless  does  not  generate  exactly  the  set;  in  combinatorial  system 
CS1  there  is  no  way  in  which  it  is  possible  to  express  that  the  number 
of  iteration  steps  must  be  the  same  for  each  of  the  two  *  in  the  formula 
(see  Curry  and  Feys  [9]).  Therefore,  in  the  theory  of  finite  automata  it 
is  not  even  -possible  to  express  the  equality  of  two  natural  numbers . 


- - -  * 
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Point  Four.  In  order  for  an  automaton  to  solve  a  (soluble)  recurs¬ 
ive  problem,  the  possibility  must  be  granted  that  it  can  be  extended  un¬ 
boundedly  in  whatever  way  might  be  required. 

These  matters  probably  appear  trivial  to  most  persons  of  a  practical 
outlook.  Since  there  is,  after  all,  no  possibility  of  constructing  an 
'arbitrarily  large'  or  even  'infinite'  automaton,  one  sinply  accepts 
things  as  they  are.  A  finite  physical  structure  can  'store  information* 
only  in  finite  amounts;  it  is  capable  of  only  finitely  many  distinguish¬ 
able  states.  From  this  it  follows  that,  as  a  matter  of  principle,  the 
automaton  cannot  recognize  irregular  messages,  if  it  is  to  be  regarded 
as  a  synchronous  structure.  It  is  only  this  last  assumption,  usually  un¬ 
pronounced,  that  we  wish  to  refute. 

As  regards  the  performance  capabilities  of  an  automaton,  it  is  by 
no  means  immaterial  at  what  place  we  bring  the  existence  of  bounds  into 
play.  This  is  apparent  whenever  the  structure  of  an  automaton  or  of  a 
program  is  itself  the  object  of  a  data  process,  a  procedure  that,  simi¬ 
larly,  is  to  be  executed  by  an  automaton.  This  step  is  not  generally 
practicable. 

As  an  example,  let  us  examine  the  translation  of  ALGOL  text  into 
machine  coding.  ALGOL  is  an  irregular  language  —  to  see  this  one  need 
only  notice  the  inductive  declarations  for  'arithmetic  expression'  or  for 
'block'  etc.  To  construct  an  ALGOL  translator  is  to  produce  a  program  for 
the  translation  of  a  substitute  language  (iterative  pseudo-ALGOL  syntax). 
The  user  of  the  translator  must  then  know  the  substitute  language  if  he 
is  to  anticipate  the  activity  of  the  translator.  This  requirement  does 
not  seem  to  be  serious;  the  user  believes  he  understands  the  necessity 
of  limitations,  such  as  the  following:  'no  more  than  500  bracket  pairs 


-23- 


may  be  nested’  or  'no  more  than  10000  names  may  appear  in  a  program'  or 
implicitly  'no  more  than  50000  instructions  may  appear  in  a  program' . 

The  difficulty,  however,  is  the  following:  as  the  complexity  of  the 
use  of  the  machine  increases,  there  arises  between  the  machine  and  the 
user  an  insoluble  problem  of  agreement,  for  the  user  necessarily  requires 
a  recursive  description  of  the  language  he  uses  for  expressing  his  prob¬ 
lem  or  in  which  another  user  has  formulated  a  problem,  if  he  wishes  to 
'understand'  the  problem.  In  the  simplest  case  he  must  know  that  within 
a  domain  a  name  token  refers  to  the  same  object  as  a  second  token  of  the 
same  form  (and  actually  more  generally,  for  arbitrarily  many  different 
names).  In  an  automaton  there  can  be  no  discussion  of  such  'comprehen¬ 
sion',  as  was  shown  by  the  example  V  0  /  /  1  R  1.  It  is  therefore  im¬ 
possible  for  the  machine  and  the  user  to  assume  the  same  complete  descrip¬ 
tion  of  a  language  as  a  common  basis  of  communication. 

Thus  it  is  not  possible  to  give  a  complete  specification  of  a  lang¬ 
uage  such  as  ALGOL,  its  semantics  included  (with  the  aid  of  equivalence 
relations)  without  leaving  the  realm  of  automata  theory,  (Success  can  be 
had,  however,  with  a  finite  nuirber  of  CS2  steps.) 

If  a  generalization  of  the  conceptualizations  of  automata  theory  can 
be  achieved  such  that  the  theory  a)  is  at  least  as  well  suited  to  .the 
physical  postulates  as  the  previous  models  and  b)  permits  communication 
in  CS2  languages,  then  therewith  the  situation  of  practical  data  process¬ 
ing  will  be  fundamentally  changed.  The  decisive  point  here  is  the  fact 
that  the  set  of  CS2  formulas  (and  therewith  the  'set  of  recursive  lang¬ 
uages')  can  be  produced  from  a  single  CS2  formula  in  the  same  way  as  the 
set  of  synfcoi  sequences  of  a  language  can  be  produced  from  the  formulas 
of  conbinatorial  system  CS2. 
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This  is  not  the  case  for  CS1,  for,  viewed  as  symbol  sequences,  the 
set  of  CS1  formulas,  just  as  the  set  of  CS2  formulas,  does  not  belong  to 
any  regular  metalanguage.  In  contrast,  it  is  easily  shown  that  there  ex¬ 
ist  finite  specifications  for  symbol-sequence  interpretation  which  allow 
an  isomorphism  between  CS2  and  the  syntax  of  the  descriptive  language 
(meta-CS2) . 

In  the  interpreted  combinatorial  system  CS2  we  therefore  have  the 
possibility  of  describing  the  syntax  of  the  metalanguage  with  the  same 
means  of  expression  as  is  used  for  the  language  itself.  If  we  use  the 
’encapsulation’  of  CS2  synbol  forms  to  designate  the  isomorphic  assign¬ 
ment  of  CS2  symbol  forms  to  meta-CS2  synbol  forms,  then  we  shall  have 
the  following  as  an  alphabet: 

{<&  <a  ®,  0.  ®} . 

Every  CS2  formula  on  the  alphabet  {(§}  ©}  is  then  derivable  in 
finitely  many  steps  from  the  following  formula: 

F2:  VVV  ©O®  /  /V  H  . 

Proof:  We  shall  number  the  individual  symbols  of  the  formula  and 

explain  them  as  follows: 

VVV  ®(D®  /  /V  @0  RR 
12  3  12  4  12 

73  specifies  the  choice  of  an  alphabet  synbol; 

V2  specifies  the  choice  between  ®  on  the  one  hand 
and  an  alphabet  synbol  on  the  other; 

V4  specifies  the  selection  of  an  operator  ®  or  0  ; 

/o  specifies  that  a  formula  is  appended  to  an  operator 
and  that  this  formula  should  form  the 
leading  partial  formula  of  that  operator; 

/l  specifies  that  a  formula  is  attached  to  the  first 
partial  formula  of  an  operator; 


and  R2  depend  only  on  Vj  and  therefore  designate 
copies  (of  the  above  formula)  that  are 
to  be  interpreted; 

Vl  specifies  the  recurrent  application  of  the  CS2 
productions  Z  +  /  IE  or  E  +  7  I  I. 

Now  the  symbol  forms  ®,  ©,  ®>  ®  must  yet  be  expressed  by  suitably 

chosen  sequences  of  the  two  as  yet  unused  symbols  of  the  metalanguage, 

0  and  1.  Here  we  have  some  freedom.  We  shall  choose  an  assignment  the 
effects  of  which  are  easily  surveyed,  and  we  shall  suppose  that  the  fol¬ 
lowing  substitutions  are  made  in  the  formula  F2: 

®  •*»  0 

(D  / 1  0 

®  •+  /  /  1  1 0 

(Z)  *  /  /  /  1  1  1 0 

®  +  /  //  /1111V0/1R 

There  then  exists  a  finite  switching  network  with  the  two  inputs  {0,  1} 
and  the  six  outputs  [2,(5)  0  (§}  QX  ©}  that  assigns  to  each  sequence  of  the 
metasynbols  (0,  1}  a  sequence  of  object  symbols  (defective  through  t)  and 
therewith  a  sequence  of  CS2  formulas;  this  network  is  to  be  seen  in 
Figure  1.  The  end  of  the  first  formula  of  the  sequence  can,  if  it  exists, 
be  recognized  by  the  counting  technique  described  above. 

Then  the  description  of  the  modus  operandi  of  the  machine  that  is 
to  interpret  the  formula  is  merely  a  more  exact  constructive  formulation 
of  what  we  have  understood  by  an  interpreted  combinatorial  system  with 
correspondingly  simple  productions.  A  machine  for  interpreting  CS2  ex¬ 
pressions  we  shall  call  an  R-machine.  This  machine  first  receives  a  CS2 
formula;  it  then  receives  an  additional  sequence  on  the  alphabet  {0,  1} 
for  controlling  the  course  of  the  recursions  —  we  can  suppose  that  this 
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Figure  1. 


sequence  of  0's  and  l’s  steins  from  another  R-machine.  Applying  a  formula 
to  a  sequence  we  shall  call  an  application,  as  in  combinatory  logic  (see 
Curry  [9]).  The  transition  from  the  metalinguistic  expression  to  the 
linguistic  expression  is  then  reduced  to  this  two-place  operation.  Since 
the  R-aachines  differ  only  in  their  CS2  formulas,  it  becomes  possible  to 
describe  them  solely  by  means  of  such  formulas,  and  even  machines  of  un¬ 
bounded  size  cay  be  described  by  finite  formulas. 

In  this  description  all  structural  differences  between  messages  and 
automata  disappear.  We  could  supplement  the  programming  of  the  R-raachines 
in  such  a  way  that  the  machine  would  not  merely  come  to  a  stop  after  re¬ 
leasing  its  output,  but  rather  would  erase  its  tape  (which  erasure  can 
be  effected  in  a  finite  number  of  steps  since  otherwise  no  output  could 
have  taken  place)  and,  by  giving  some  signal,  indicate  that  it  is  pre¬ 
pared  to  receive  a  new  CS2  formula.  We  could  then  follow  the  flow  of  in¬ 
formation  in  an  applicative  system  (see  Curry,  [9]):  this  system  would 
consist  of  a  set  of  objects  (namely  finite  formulas)  on  which  there  is 
a  threo°place  relation:  Formula  1  applied  to  Formula  2  yields  Formula  3. 
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Since,  as  was  mentioned  above,  the  interpretation  of  CS2  embraces 
with  it  that  of  CS1,  an  R-machine  presented  with  a  token  of  F2  can  pro¬ 
duce  the  description  of  any  finite  automaton  (switching  circuit) ,  and, 
further,  it  can  produce  any  finite  sequence  of  0's  and  l's  (through  the 
appending  of  a  0).  In  particular,  the  description  of  a  universal  Turing 
machine  can  be  generated,  and  therewith,  therefore,  every  Turing  machine 
(with  suitable  arrangements  regarding  coding). 

Now  one  knows  from  the  theory  of  Turing  machines  (see  Davis  [10]) 
that  there  can  exist  no  algorithm  (itself  to  be  represented  by  a  Turing 
machine)  that,  presented  with  Formula  1  ('Program')  and  Formula  2  ('out¬ 
put  data'),  allows  a  decision  as  to  whether  Formula  3  (application  result) 
exists,  i.  e.  whether  the  sequence  representing  it  (F3)  is  finite;  see 
Davis  [10]  p,  70.  For  the  attempt  to  execute  an  application  there  is  in 
general  no  guarantee  of  success  and  actually  no  guarantee  that  success 
can  be  achieved  in  any  previously  specified  number  of  computational  steps. 
If  one  is  interested  in  the  result  of  an  application  then  the  only  thing 
to  do  is  to  start  the  process  and  then  to  wait  for  a  completion  signal, 
about  which  we  can  in  general  say  nothing  regarding  its  appearance  with¬ 
in  any  given  time  span.  This  well-known  fundamental  fact  of  irregular 
communication,  along  with  physical  considerations,  should  serve  as  fur¬ 
ther  impetus  for  choosing  the  primitive  'switching  elements'  in  such  a 
way  that  only  that  property  is  required  of  them  that  is  indispensable 
only  in  the  total  system  and  can  be  effectively  preserved  even  in  an  un¬ 
bounded  system:  namely  the  invariance  of  certain  combinatorial- topologic¬ 
al  connexions  between  neighboring  elements. 

Point  5.  Automata  formulated  in  accordance  with  automata  theory 
will,  after  a  finite  nuirber  of  extensions,  conflict  with  at  least  one  of 
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the  postulates  nam<>d  above.  John  von  Neumann  (in  unpublished  work,  accord¬ 
ing  to  a  note  in  [2])  and  A.  W.  Burks  [2]  have  specified  the  construction, 
from  logical  elements  (A,  V,  ^)  and  delay  elements,  of  a  memory  that  has 
the  same  modus  operandi  as  the  tape  of  a  Turing  machine.  In  that  work, 
infinitely  fast  signals  are  presupposed,  whereby  the  memory  contradicts 
one  of  the  postulates  from  the  very  start.  The  construction  can  now  be 
modified  by  adding  a  rule  (namely  one  corresponding  to  the  postulate  of 
finite  signal  velocity)  to  the  rule  for  element  connexion,  the  latter 
rule  being  defined  over  a  planar  square  net;  this  is  done  in  such  a  way 
that  any  signal  connecting  the  point  with  (integral)  net  coordinates 
(xl»  yi)  with  a  point  (x2,  y2)  will  have  to  pass  through  at  least  D  de¬ 
lay  elements,  where 

D  *  d»(|x2-x1j  +  |y2-yi|) ,  where  d  is  constant  0  <  d  <  1. 

Then,  in  the  case  of  growing  memories,  the  number  of  delay  elements  is 
not  bounded,  and,  therewith,  their  distance  from  each  other  is  not 
bounded  either.  If  the  distance  were  bounded  then  we  could  achieve  syn¬ 
chrony  of  the  delay  elements  by  means  of  time  signals,  so  that  the  in¬ 
exactness  of  the  delay  time  AA t  could  in  no  case  lead  to  the  situation 
that  a  later  object  signal  would  overtake  an  earlier  one  on  another  path. 

These  time  signals  would  now  have  to  connect  arbitrarily  distant 
points,  and  therefore  they  must  themselves  be  subject  to  the  supplement¬ 
ary  connexion  rule  (regarding  signal  speed) .  And  therewith  new  delay 
elements  have  to  be  added,  the  number  of  which  is  again  proportional  to 
the  observed  distance,  and  these  new  delay  elements  will  themselves  have 
to  be  synchronized  with  time  signals  and  laid  upon  free  lattice  points 
of  the  net. 

Even  if  we  grant  the  possibility  of  only  linear  extension 
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of  the  automaton  that  is  to  be  extended  and  even  if  we  admit  an  n-dimen- 
sional  net,  then  for  every  k  and  d  there  can  be  found  an  l  such  that 
N  >  k*Ln  if  L  >  l  {k  >  0,  0  <  d  <  1) 
where  L  is  the  length  of  the  linear  arrangement  of  switching  elements 
that  is  to  be  constructed  and  is  to  be  established  by  the  enumeration  of 
(n-I) -dimensional  planes,  and  where  N  is  the  total  number  of  delay  ele¬ 
ments  required  by  the  connexion  rules.  Thus  the  elements  cannot  be 
placed  in  the  net  even  if  a  mere  linear  string  is  postulated  all  the  ele¬ 
ments  of  which  are  of  the  same  form. 

Thus  the  only  course  left  open  to  us  is  either  to  admit  d  =  0  (and 
therewith  infinite  signal  velocity)  or  to  postulate  arbitrarily  exact 
delay  elements.  If  we  suppose  delay  members  to  be  physical  assemblies 
with  spatial  extension,  then  the  possibility  must  be  granted  that  such 
elements  can  be  constructed  in  such  a  way  that,  coupled  back  into  them¬ 
selves  as  'clocks',  they  will  after  an  arbitrarily  long  time  have  read¬ 
ings  differing  by  at  most  one  time  pulse.  We  deny  this  possibility  to  an 
even  greater  extent  than  does  relativity  theory,  for  we  shall  deny  it 
even  for  clocks  at  rest  relative  to  each  other.  We  can  now  deliver  this 
as  a  postulate; 

PI  The  synchrony  of  clocks  can  he 
brought  about  only  by  means  of 
cormtunication . 

A  more  far-reaching  formulation  of  this  postulate  is  of  some  epistemo¬ 
logical  interest:  The  concept  of  'the  synchrony  of  two  clocks'  receives 
its  content  exclusively  through  the  description  of  a  dosed  signal  chain 
that  contains  both  clocks. 

In  this  formulation  the  postulate  is  not  to  be  defended  at  this 
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time;  on  the  other  hand,  however,  we  do  accept  the  first  form  and  we 
shall  substantiate  this  with  the  postulate  regarding  the  finiteness  of 
the  density  of  information,  for  we  can  describe  an  experiment  in  which 
the  pulse  times  of  the  two  clocks  are  compared  with  any  desired  exact¬ 
ness  by  counting  pulses  and  in  which,  therefore,  Atj  is  measured  with 
reference  to  a  unit  A£o*  Any  positive  rational  number  can  be  obtained  as 
the  measure  of  A  t\,  If  we  assume  that  the  sequence  of  these  numbers  will, 
as  the  experiment  progresses,  approach  a  limit  value  that  is  dependent 
only  on  the  physical  state  of  the  clocks  at  the  beginning  of  the  experi¬ 
ment,  then  we  ascribe  to  the  pair  of  clocks  an  information  content  that 
exceeds  any  bound.  Since  we  do  not  possess,  let  alone  manipulate,  this 
information  content,  it  follows  that  it  is  conceptually  simpler  to  fore¬ 
go  even  mentioning  it  in  the  construction  of  a  theory  of  communication. 
This  important  step  will  be  carried  out  in  all  cases  involving  real  num¬ 
bers:  spatial  coordinates,  physical  measure  of  a  state  (of  which  we 
shall  speak  explicitly),  probability,  et  cetera. 

3.  Prolegomena  to  a  Reformulation 

By  means  of  the  arguments  advanced  above,  it  has  been  shown  why  we 
must  reject  not  only  switching  elements  without  time  requirements  (A,  V, 
",...)  but  also  those  with  fixed  specified  time  requirements  (At)  as 
idealizations  of  our  elementary  logical  components,  if  we  are  to  keep 
the  physical  realization  of  automata  of  variable  total  structure  in 
sight.  We  may  reject  them  als<^  however,  for  automata  of  fixed  finite 
structure.  It  is  to  be  shown  now  that  it  is  possible  to  specify  other 
idealizations  for  logical  components  such  that  the  following  is  valid: 


P2A  Every  logical  element  in  its  ideal- 
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ized  form  has  a  manipulable  model 
in  every  field  in  which  actual  com¬ 
munication  takes  place. 

If  this  is  successful  then  mathematical- logical  models  of  general  com¬ 
munication  processes  can  be  constructed  that  are  exact  in  a  stronger 
sense  than  could  be  achieved  without  this  assumption.  Also  it  is  to  be 
hoped  that  such  models  will  enable  a  deeper  view  into  the  nature  of 
communication. 

By  communication  we  understand  all  forms  of  the  actual  flow  of  in¬ 
formation.  The  information  flow  describes  the  structural  properties  of 
the  quantities  that  are  known  as  * effect'  in  physics.  The  requirement 
P2A  should  assure  us  of  the  universality  of  our  model  of  communication. 
But  how  should  one  demonstrate  that  the  condition  is  fulfilled?  Such  a 
demonstration  will  not  be  attempted  here,  but  we  do  wish  to  make  such  a 
demonstration  as  easy  as  possible;  this  we  do  by  changing  the  require¬ 
ment  P2A  from  its  indirect  form  into  its  direct  form  and,  therewith,  by 
strengthening  it  somewhat: 

P2  In  the  interpretation  of  idealized 
logical  elements,  one  may  appeal  only 
to  such  finite  properties  of  the  phys¬ 
ical  objects  realizing  these  elements 
as  have  their  invariance  insured  by  a 
general  principle . 

The  problem  is  therewith  shifted  to  the  concept  of  the  general 
principle  (GP).  The  philosophical  implications  of  the  concept  need  not 
concern  us  here.  We  wish  to  give  three  examples  of  GPs  that  are  already 
sufficient  for  the  switching  elements  that  are  to  be  introduced  below 
(Section  5): 
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GP1  The  existence  of  a  quantised  quantity 
(e.  g.  effect,  change) 

GP2  The  validity  of  a  law  of  conservation 
(e.  g.  of  charge) 

GP3  The  validity  of  a  reaction  principle 
(e.  g.  for  forces) 

These  principles  have  been  selected  because  they  have  the  form  of 
the  best  assured  pronouncements  of  physics.  It  turns  out  that,  taken  to- 
gether,  these  severely  limit  the  freedom  in  the  choice  of  logical  ele¬ 
ments.  We  must  show,  then,  that  from  the  elements  yet  permitted  we  may 
actually  produce  structures  that  can  ‘steer’  the  flow  of  information  in 
any  way  that  might  be  desired. 

Now  an  obvious  objection  is  that  such  a  renunciation  of  the  class¬ 
ical  switching  elements  leads  us  directly  into  the  field  of  asynchronous 
automata,  which  are  regarded  as  mathematically  so  difficult  that  one 
must  give  up  hopes  for  clarity  (see  [18],  p.204),  indeed  so  difficult 
that  a  practical  application  can  be  considered  only  in  the  simplest  case. 
Remarkably  enough  this  objection  disappears  completely  if  we  construct 
the  theory  in  a  consistent  way  anew  with  the  application  of  the  postul¬ 
ates  PI  and  P2,  therefore  with  the  renunciation  of  certain  additional, 
normally  accepted  possibilities,  thus  by  limiting  our  means  of  repre¬ 
sentation.  Further  we  seek  a  way  in  which  to  describe  deterministic  pro¬ 
cesses  with  the  same  means  and  in  which  to  explain  the  difference  between 
the  two  by  means  of  the  topological  properties  of  finite  structures  over 
discrete  sets. 

An  essential  characteristic  of  the  way  in  which  we  shall  proceed  is 
that  we  must  completely  reject  metrical  properties  of  all  types.  Our  only 
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presupposition  is  that  there  are  objects  with  some  invariant  properties 
(to  be  interpreted,  according  to  the  context,  as  energy  amounts,  effect 
quanta,  electrical  charges,  material  particles,  etc.),  between  which 
there  are  bounded  connexions.  We  shall  connect  these  objects  into  nets 
and  show  that  there  exist  nets  equivalent  to  a  Turing  machine,  the  dis¬ 
tant  parts  of  which  nets  can  be  produced  without  reference  to  the  start¬ 
ing  point,  thus  without  communication  between  arbitrarily  distant  dis¬ 
tant  parts  of  the  net(s).  It  will  thus  be  shown  that  such  a  net,  even  if 
it  consists  of  only  a  few  objects,  can  not  be  distinguished  by  an  experi¬ 
ment  from  an  'infinite'  net  capabJe  of  recognizing  recursive  messages, 
and  that,  to  that  extent,  such  a  net  will  be  equivalent  to  the  'infin¬ 
ite'  net. 

In  order  that  the  connexion  with  applications  might  emerge  more 
clearly,  we  shall  forego  the  mathematically  more  elegant  possibility  of 
treating  the  temporal  neighborhood  relation  and  the  spatial  neighbor¬ 
hood  relation  between  phase  cells  in  the  same  manner;  we  shall  therefore 
speak  of  nets  and  their  modifications  rather  than  of  cell  complexes. 

We  shall  now  proceed  as  follows: 

a)  We  specify  a  method  of  producing,  with  the  aid  of 
intuitively  selected  nonmetric  switching  elements, 
certain  nets  that  reproduce  the  physical  flow  of 
information,  thus  the  structural  relationship  of 
event  classes.  We  therewith  fulfill  only  GP1,  not, 
however,  GP2  or  GP3  (Section  4). 

b)  We  limit  the  choice  of  switching  elements  by  re¬ 
quiring  that  GP1,  GP2,  and  GP3  be  fulfilled,  so 
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that  P2  can  be  verified.  The  way  is  therewith 
cleared  for  applications ,  and  the  basic  pheno¬ 
mena  of  communication  are  representable  with 
purely  combinatorial-topological  means  (Section  5). 

At  step  a)  we  shall  speak  as  if  the  discrete  objects  were  embedded  in 
a  continuous  space-time  world,  in  order  to  make  understanding  somewhat 
easier.  It  should  be  remarked,  however,  that  this  is  by  no  means  necess¬ 
ary;  the  ostensible  continuum  rests  in  the  final  analysis  on  the  erron¬ 
eous  assumption  that  the  axiom  of  density  (see  [6],  p.154)  has  an  oper¬ 
ational  sense  (see  for  example  [20]).  The  axiom  is  rather  a  rhetorical 
instrument  for  the  construction  of  hypotheses  in  the  sense  of  inductive 
logic  (see  [5]  or  [21]). 


4.  A  Reformulation 

Using  the  and-gate  (Figure  2)  as  an  example,  we  shall  explain  the 
approach  that  is  to  be  introduced  presently.  Such  a  switching  element 
connects  three  things  (wires,  for  example)  that  assume  certain  states 
(potentials,  for  example)  at  certain  times.  This  connexion  is  of  the 

following  sort;  let  the  sets  of  poss¬ 
ible  states  of  a,  b,  and  c  be  Sa,  Sb, 
and  Sc  respectively;  let  0a  and  la  be 
disjoint  subsets  of  Sa,  and  so  similar¬ 
ly  for  b .and  c.  The  effect  of  the  gate 
is  described  by  means  of  a  mapping  of  the  set  of  all  state- triples  into 
itself;  the  fixed  points  of  the  mapping  are  the  stable  state-triples. 

We  can  characterize  the  mapping  by  means  of  directed  line  segments  con- 


Figure  2, 
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necting  the  vertices  of  a  cube.  Figure  3  character¬ 
izes  the  following  mapping  for  the  and-gate: 

Oa  Ob  Oc  Oa  Ob  Oc  ..... 

Oa  Ob  lc  Oa  Ob  Oc  la  lb  Oc  *►  la  lb  lc 

Oa  lb  Oc  -*•  Oa  lb  Oc  la  lb  lc  la  lb  lc  . 

The  point  designating  the  state  of  the  gate  passes 
through  the  weakly  marked  edges  through  the  action  of  influences  external 
to  the  circuit;  the  strongly  marked  edges  it  passes  through  'of  its  own 
accord',  that  is  to  say,  on  the  basis  of  the  physical  properties  of  the 
switching  element.  It  should  be  remarked  that  in  the  traversal  of  these 
c-edges  the  state  of  a  and  b  may  not  be  changed  in  such  a  way  that  it 
again  leaves  the  particular  subset  Oa,  la,  Ob,  or  lb  to  which  it  belongs. 
That  may  be  achieved  with  certainy,  however,  only  by  virtue  of  the  fact 
that  the  c-edges  run  parallel  to  the  c-axis  of  a  state- coordinate  system 
without  regard  to  whether  the  state-sets  are  considered  to  be  dense  or 
discrete.  That  means,  however,  that  a  physical  process  must  here  run  its 
course  with  no  reaction  on  its  cause.  Thus,  even  without  the  requirement 
that  the  process  take  place  'in  a  very  short  time',  we  have  no  exact 
physical  model  available  that  behaves  correspondingly:  the  and-gate  does 
not  satisfy  postulate  P2. 

We  shall  now  examine  the  switching  element  W  (Figure  4) ,  which  has 

the  following  simple  properties  (see 
also  Figure  5) : 

la  lb  Oc  -*•  Oa  Ob  lc 
(all  other  triples  are  stable). 

This  switching  element  we  could  de- 


4 


-  '  1. 


-36- 


signate  as  an  * and-gate  with  reaction*:  in  that  c  enters  into  the  state 
lc,  a  and  b  are  shifted  into  the  states  Oa  and  Ob  respectively.  Since 

all  states  are  changed  in  the  traversal  of  the 
’active  edge*  of  the  element,  the  difficulty  of 
interpretation  mentioned  above  does  not  even 
arise,  ds'e  can  elucidate  the  behaviour  of  the 
switching  element  as  follows:  W  waits  until  it 
observes  the  objects  la  and  lb  in  its  neighbor¬ 
hood  and  produces  from  these  a  new  object  lc.  This  waiting  of  the 
switching  element  W  should,  however,  by  no  means  be  thought  of  as  an 
activity,  say  of  the  type  such  that  the  element  repeatedly  interrogates 
the  states  of  a,  b,  and  c  and  then  on  the  occasion  of  some  particular 
result  of  the  interrogation  changes  the  states  of  a,  b,  and  c;  rather  it 
merely  represents  a  connexion  of  a,  b,  and  c  that  will  occasion  a  state 
change  only  if  la,  lb,  and  Oc  are  all  present,  and  the  state  change  con¬ 
sists  only  in  the  fact  that  after  its  entrance  (or  occurrence)  the  ob¬ 
jects  Oa,  Ob,  and  lc  are  present. 

The  process  of  the  substitution  of  Oa,  Ob,  lc  for  la,  lb,  Oc  we 
view  as  a  single  elementary  process  that  can  no  longer  be  divided  into 
separate  parts;  below  (Section  5)  we  shall  admit  only  physically  mean¬ 
ingful  processes  as  elementary,  a  procedure  that  first  complicates  the 
constructions  considerably  but  yields  remarkably  simple  results. 

On  the  other  hand  there  shall  be  required  of  a  connexion  (switch¬ 
ing  element)  W  nothing  more  than  the  described  behaviour;  we  require  only 
that  Oa  Ob  lc  be  a  (temporal)  successor  of  la  lb  Oc,  and  we  shall  write 

W  (a  b  c)  :  110+001  . 
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We  need  say  nothing  regarding  a  ’time  requirement'  of  this  process.  As 
must  be  clear  from  the  interpretation,  the  disappearance  of  an  object  la, 
the  disappearance  of  an  object  lb,  and  the  appearance  of  an  object  1c  are 
all  the  same  act. 

For  the  characterization  of  the  full  breadth  of  the  possibilities 
of  interpretation  the  following  remarks  are  essential: 

1)  Duality  between  0-objects  and  1-objects:  We  can  character¬ 
ize  the  same  switching  element  W  in  two  ways: 

W  =  la  lb  -+•  lc  and  W  =  Oc  -*•  Oa  Ob. 

If  instead  of  1-objects  we  observe  the  0-objects  dual  to  them,  then  the 
operation  of  W  consists  in  the  splitting  of  one  object  into  two  objects 
different  from  it  and  from  each  other.  A  net  consisting  of  such  elements 
and  similar  ones  may  therefore  be  conceived  of  in  different  way  according 
to  which  of  the  two  object  classes  one  wishes  to  mark.  We  shall  therefore 
make  the  following  agreement:  the  assignment  of  the  symbols  0  and  1  to 
the  object  classes  is  arbitrary  but  it  must  be  kept  fixed.  If  we  wish  to 
distinguish  an  object  class  we  shall  do  this  by  assigning  the  symbol  1 
to  it.  By  interchange  of  the  object  classes  a  switching  element  passes 
over  into  its  dual : 

I(abc)  :  00  1+110  . 

For  switching  elements  that  change  all  of  the  objects  treated  to  another 
class,  the  passage  to  the  dual  element  is  obviously  equivalent  to  an  inter¬ 
change  in  the  sense  of  temporal  direction. 

2)  Operation  Domain  of  a  Switching  Element:  The  'connexions' 

of  a  switching  element,  designated  by  a,  b,  and  c,  are  its  (three)  domains 
of  operation:  if  a  1-object  (or  in  the  dual  case  a  0-object)  appears  in  a 


-38- 


4 


domain  of  operation  it  can  be  perceived  by  the  switching  element. 

One  possible  way  of  interpreting  the  domain  of  operation  is  by  as¬ 
signing  to  it  a  spatial  (or  spatio-temporal)  region.  The  question  then 
arises  as  to  the  exact  delimitation  of  this  region,  but  we  shall  once 
again  arrange  our  basic  concepts  in  such  a  way  that  the  question  will 
have  no  object.  We  make  the  following  agreement:  if  in  an  interpretation 
spatial  (or  spatio-tenporal)  regions  are  assigned  to  operation  domains, 
then  these  regions  shall  not  be  capable  of  reinterpretation  except  as 
domains  of  operation  of  switching  elements.  The  only  things  we  need  then 
are  the  topological  properties  of  regions:  separation,  intersection,  and 
inclusion. 

Domains  of  operation  with  no  statement  of  their  interpretation  we 
shall,  for  brevity,  refer  to  as  locations  (ox  places).  The  switching 
element  W  is  thus  ’three-place'. 

In  the  most  important  interpretations  each  domain  of  operation  can 
take  in  only  a  uniform  limited  number  of  objects.  It  suffices  then,  as 
will  be  seen,  to  allow  only  locations  that  contain  exactly  one  object  at 
all  times.  The  transition  to  'locations'  that  at  all  times  contain  exact¬ 
ly  n  objects,  which  we  can  call  quasimetric  locations ,  is  always  possible 
by  connecting  ordinary  locations  with  suitable  switching  elements. 

Switching  elements  with  no  statement  of  interpretation  we  shall 
refer  to  as  nodes . 

We  now  wish  to  admit  the  following  relations  between  locations: 
identity,  vicinity,  and  separation  (=  nonidentity  A  nonvicinity),  but 
not  general  intersection  or  inclusion.  We  do  this  by  means  of  the  fol¬ 
lowing  definitions,  in  accordance  with  our  previous  agreement  concern- 
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ing  the  treatment  of  the  interpretation. 

If  a,  b,...  are  the  domains  of  operation  of  a  switching  element  X, 
then  we  say  that  the  locations  a,  b,...  belong  to  the  node  K: 

J  (a,  K),  J  (b,  K) ,  ....  ( incidence ). 

Two  locations  a  and  b  are  identical  if  they  contain  the  same  objects: 
I  (a,  b).  Thus  it  is  immaterial  whether  we  take  identity  between  locations 
or  between  objects  as  basic.  The  relation  I  is  reflexive,  symmetric,  and 
transitive;  we  ought  to  call  the  equivalence  classes  of  locations  that  I 
imposes  I-locations,  but  we  wish,  further  on,  to  observe  only  these,  and 
we  wish  to  use  the  word  'location'  for  these,  too.  The  distinction  does 
not  become  essential  until  we  completely  formalize  the  rules  for  net 
construction. 

Two  different  locations  are  called  vicinal ,  and  we  write  N(a,  b) , 
if  there  exists  a  node  to  which  both  belong: 

N  (a,  b)  =  (3K)(J  (a,  K)  •  J  (b ,  K))  •  <\J  (a,  b)  . 

The  relation  N  is  irreflexive,  symmetric,  andnontransitive. 

We  observe  only  those  locations  that  belong  to  at  least  one  node, 
for  it  is  only  through  incidence  with  a  node  that  a  location  can  take 
part  in  communication: 

Lo  (a)  =  (3K) (J  (a,  K))  (a  is  a  location }  . 

Two  different  locations  are  called  connected ,  and  we  write  C  (a,  b) , 
if  there  is  a  natural  number  n  £  1  such  that  there  is  an  N-chain  of  n 
links  between  them; 

C  (a,  b)  =  (Bn) (Nn  (a,  b))  . 

The  relation  C  is  symmetric  and  transitive. 

We  now  need  a  set  of  two  elements,  which  we  designate  by  the  sym- 
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bols  0  and  1.  We  shall  call  these  elements  bits  and  write: 

Bit  (i)  =  i  e  {0,  1}  . 

We  shall  define  an  object  as  an  ordered  pair  consisting  of  a  loca¬ 
tion  and  a  bit  and  we  shall  write  Ob  (a,  i): 

Ob  (a,  i)  o  Lo  (a)  •  Bit  (i)  . 

Thus,  we  shall  use  the  word  'object'  here  in  such  a  way  that  it  would  be 
senseless  to  say  that  an  object  moves  from  place  to  place  (location  to 
location).  The  genidentity  (see  [6],  pp,199f.)  of  information  sets  (or 
particles)  must  rather  be  described  by  the  statement  of  a  net  structure; 
this  genidentity  is  not  necessarily  independent  of  the  observer. 

The  N-relation  imparts  a  structure  to  a  set  of  locations,  the  N- 
structure ,  and  we  shall  call  a  connected  N-structure  an  N-net.  By  the 
valuation  of  the  locations  of  an  N-net  we  obtain  a  connected  N-structure 
over  a  set  of  objects.  This  structure  represents  the  'state  of  a  system' 
in  automata  theory.  There  it  is  presupposed  that  one  can  state  or  even 
produce  a  successor  relation  over  a  set  of  such  structures.  Here  we  free 
ourselves  of  this  condition  by  demonstrating  that  it  cannot  always  be 
fulfilled. 

We  shall  admit  instead  only  the  successor  relation  '  •*«  '  for  ordered 
p- tuples  of  such  objects  as  (so  to  say)  occur  at  locations  belonging  to  a 
single  node.  For  unlimited  p  we  obtain  once  again  the  conceptual  struc¬ 
tures  of  the  theory  of  synchronous  automata,  which  would  represent  in  this 
view  a  sort  of  theory  of  action  at  a  distance.  The  essential  deviation  of 
our  approach  from  that  of  the  theory  of  synchronous  automata  lies  then  in 
the  limiting  of  p  (to  small  natural  numbers) ,  and  in  the  interpretation 
only  short-distance  effects  (actions)  are  taken  into  consideration. 
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As  an  initial  attempt  we  shall  arbitrarily  choose 

P  =  4  Up  $  ? 

and  we  shall  agree  that  in  the  statement  of  the  actions  of  a  node,  e.  g. 

p  8  3  :  i  (a  b  c)  :  110  +  001  , 

we  shall  always  name  all  of  the  locations  belonging  to  the  node.  This  is 
no  limitation  of  generality.  There  are  thus  no  more  than  P  locations  be¬ 
longing  to  any  node. 

The  inverse  of  an  action  derives  from  an  interchange  of  the  left 
and  right  sides  of  the  successor  relation.  We  shall  call  a  node  reverse 
ible  if  for  each  of  its  actions  it  also  possesses  its  inverse.  The  num¬ 
ber  F  of  possible  different  switching  functions,  i.  e.  of  examples  of 
nodes  with  actions,  is  bounded,  namely 


Thus  for  P  =  4,  P  <  2257.  We  wish  to  make  do  with  but  a  small  numbe-.-  of 

these,  however,  and  we  define  the  following  actions: 

Q  (a)  :  0  +  1 

T  (a  b)  :  10  +  01 

W  (a  b  c)  :  110  +  001 

V(abc)  :  100  +  001 

0  10  +  001 

U(abc)  •  100  +  011 

110+001 

S(abcd)  :  0100  +  0001 

1100  +  0010 


and  the  following  inverses: 
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Q  (a)  :  1  +  0 

T  (a  b)  =  T  (b  a)  :  0  1+10 

(9  (a  be)  :  0OU110 

These  functions  have  been  chosen  only  because  of  their  clarity,  and 
in  Section  5  they  will  be  replaced  by  simpler  ones.  Here  we  have  sources 
(Q)  of  distinguished  objects,  transport  (T)  of  bits,  the  waiting  (W)  for 
the  appearance  of  two  particular  objects,  the  joining  (V)  of  bit-channels, 
the  dualization  (U)  of  an  object,  and  a  function  (S)  that  permits  the  de¬ 
structive  readout  of  a  store.  The  defined  relations  can  obtain  only  be¬ 
tween  vicinal  locations;  thus,  for  example, 

S(a  bcd)D  N(a  b)«N(a  c)«N(a  d)«N(b  c)«N(b  d)*N(c  d)  . 

There  is  also  implied  therewith  the  nonidentity  of  the  locations  of  a 
node. 

An  f-net  we  shall  define  as  a  structure  produced  by  elements  from 
a  set  /  of  P- limited  switching  functions  (i.  e,  switching  functions  con¬ 
necting  at  most  P  locations)  over  a  set  of  locations  such  that  the  im¬ 
plied  tf-structure  is  an  tf-net  and  is  thus  connected. 

For  the  most  important  interpretations  we  must  impose  on  the  /-nets 
a  further  limitation  by  taking  into  consideration  the  fact  that  not  every 
object  is  immediately  accessible  from  all  locations  at  all  times.  We  re¬ 
quire  that  no  location  belong  to  more  than  M  different  nodes;  1  <  m  <  M» 

We  now  consider  the  important  case  in  which  M  *  2.  By  the  terra  net  we 
shall  therefore  mean  an  /-net  with  P  *  4  and  K  »  2. 

The  ^-structure  of  a  net  can  be  conveniently  represented  then  by 
means  of  a  graph  whose  edges  and  nodes  correspond,  respectively,  to  loc¬ 
ations  and  nodes.  We  now  wish  to  arrange  certain  nets  in  such  a  way  that 
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for  every  object  it  is  always  uniquely  determined  in  which  action  of 
which  node  it  can  take  part.  The  behaviour  of  the  net  is  then  obviously 
determined  if  we  require  additionally  that  different  actions  of  a  node 
differ  in  their  left-hand  sides. 

By  a  (case  of)  conflict  we  shall  mean  a  situation  in  which  an  object 
belongs  to  the  left-hand  side  of  more  than  one  applicable  action.  It  is 
then  completely  indeterminate  which  of  the  actions  is  applied.  The  fol¬ 
lowing  is  criterion  for  the  identification  of  a  conflict:  A  conflict  is 
said  to  have  been  present  if  and  only  if  an  applicable  action  loses  its 
applicability  other  than  through  its  application. Nets  in  which  conflicts 
are  impossible  will  be  said  to  be  conflict-free.  This  freedom  from  con¬ 
flict  must  be  proven  by  means  of  its  'hereditary  character'  vis-a-vis  the 
steps  in  the  construction  of  the  net. 

But  what  is  to  happen  to  the  critical  object  in  the  case  of  con¬ 
flict?  In  consideration  of  the  interpretations  we  propose  the  following: 

Axiom:  In  case  of  conflict  at  most 
one  action  can  take  place. 

The  only  thing  that  remains  undetermined  (or  indeterminate)  then  is  which 
of  the  actions  comes  into  question;  in  no  case  can  several  actions  be 
applied  simultaneously. 

The  peripheral  locations  of  a  r.et  we  shall  define  as  those  locations 
that  belong  to  exactly  one  node  of  the  net. 

If  we  identify  a  pair  of  peripheral  locations  of  two  conflict-free 
nets,  it  is  not  necessarily  true  that  a  conflict-free  net  will  result. 

The  same  applies  if  the  same  nodes  are  connected  by  T-nodes  instead  of 
being  identified.  This  situation  may  be  seen  in  the  following  example. 
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We  nay  take  the  following  as  an  example  two  conflict-free  nets  be¬ 
ing  combined  to  foxm  a  net  that  is  not  conflict-free.  In  Figure  6  let 
Net  1  be  a  •clock’,  Net  2  an  observer  with  his  own  clock;  we  define 

Net  1:  T  (a  b)  Net  2:  S  (f  *  g  h) 

T  (b  c)  ft  (1  j  g) 

T  (c  d)  ft  (m  i  h) 

U  (d  e  a)  V  (i  j  k) 

Initially  we  let  the  following  conditions  prevail:  la,  lk;  we  let  the 

rest  of  Net  2  act  as  Q(A)  and  Q(m) ,  Each  net  by  itself  is  conflict-free, 
but  the  measurement  of  the  ’motion’  of  the  clock  abed  with  reference 
to  the  'motion'  of  clock  h  i  k  by  means  of  the  connection  or  identifica¬ 
tion  of  e  and  f  is  always  bound  up  with  the  possibility  of  a  conflict 
the  critical  object  of  which  can  lie  in  either  e  or  f.  These  circum¬ 
stances  indicate  to  us  a  close  connection  between  measurement  and  con¬ 
flict  that  will  not  go  unattended. 

A  conflict-free  net  with  two  peripheral  locations  that  contains 
only  n  >  1  T-nodes  we  shall  call  a  channel.  The  T-nodes  must  be  orient¬ 
ed  in  the  same  way,  and  there  is  given  therewith  also  an  orientation  of 
the  channel.  An  oriented  location  is  defined  as  a  location  that  belongs 
to  exactly  two  nodes  such  that  all  the  actions  of  the  first  node  carry 
the  object  of  the  location  over  into  its  dual  and  all  actions  of  the 
second  node  do  the  same  in  the  opposite  sense.  In  the  graph  representa¬ 
tion  we  shall  designate  such  locations  by  a  directed  arc, 

A  net  is  said  to  be  capable  of  camunication  if  it  has  peripheral 
locations.  Communication  between  two  nets  is  made  possible  by  the  identi¬ 
fication  of  peripheral  locations.  There  arises  then  an  aggregate.net  that 
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can  be  described  with  the  same  methods  as  the  individual  nets.  When  we 
speak  of  communication  with  a  net  we  imagine  ourselves  in  the  position 
of  a  partial  net,  but  we  do  not  immediately  have  the  possibility  of  ap¬ 
plying  to  this  partial  net  the  same  forms  of  description  as  were  arranged 
for  nets.  Rather  we  must  use  colloquial  expressions  for  the  actions  that 
we  exert  on  the  common  peripheral  locations.  Thus  there  will  appear  such 
concepts  as  the  following:  ’signal’,  ’information’ , 'condition',  ’until’, 
and  various  others. 

On  the  other  hand  we  can  frequently  specify  a  net  that  exactly  (or 
at  least  to  some  exactly  delimitable  extent)  describes  our  behaviour, 
our  intentions,  our  cognizance,  etc.  The  comparison  of  the  colloquial 
formulation  and  the  net  will  thus  yield  a  sort  of  prescription  for  trans¬ 
lation  between  colloquial  language  and  net  language,  which  except  for  the 
explicit  and  partially  divergent  treatment  of  temporal  connections  is 
similar  to  the  language  (or  linguistic  forms)  found  in  symbolic  logic 
(see  [6]  for  example) , 

It  has  turned  out,  however,  that  a  large  number  of  nets  that  can  be 
obtained  in  this  way  are  not  conflict-free,  and  it  can  often  be  demon¬ 
strated  that  there  exists  no  equivalent  conflict-free  net,  as  in  the 
following  example:  We  follow  a  plan  of  the  form  ’If  A  or  B,  then  C',  Let 
NA,  NB,  and  NC  be  any  nets  with  which  we  can  communicate.  It  should  be 
emphasized  that  communication  can  take  place  only  via  the  peripheral 
locations;  if  we  were  to  allow  the  possibility  of  changing  the  nets  un¬ 
der  our  control  by  operating  on  interior  locations  (i.  e,  nonperipheral 
locations)  or  interior  nodes,  then  we  should  reach  a  contradiction  of 
our  definition. 


^ ,  ’ 


Hie  condition  ’if  A*  means  in  the  interpretation  of  the  plan  that 
in  order  to  test  whether  the  condition  is  fulfilled  we  give  a  signal  to 
NA;  that  is  to  say,  by  means  of  an  action  we  alter  the  object  of  a  peri¬ 
pheral  location  of  NA  and  we  make  note  of  the  fact  that  we  have  changed 
it.  We  now  begin  to  observe  the  peripheral  locations  of  NA  (or  perhaps 
the  peripheral  location  with  changed  object  as  the  only  one)  and  prepare 
an  action  that  becomes  applicable  if  and  only  if  NA  carries  out  certain 
actions  on  its  peripheral  locations  thereby  changing  the  peripheral  ob¬ 
jects.  We  can  even  prepare  two  actions,  which  will  be  assigned  to  a  'yes' 
or  'no'  answer  from  NA.  The  execution  of  a  prepared  action  represents  the 
perception  of  the  answer.  Even  if  we  have  exact  knowledge  of  the  structure 
of  NA,  we  can  in  no  way  force  the  answer  within  a  prescribed  -‘span  of 
time.'  This  mode  of  expression  would  have  the  following  meaning:  we  have 
a  cyclic  chain  of  action  that  is  not  in  connexion  with  NA;  we  repeatedly 
interrogate  the  peripheral  objects  of  NA  ’to  the  beat'  of  this  clock. 

The  possibility  of  interrogation  means,  however,  that  the  chain  of  ac¬ 
tions  proceeding  through  NA  to  the  answer  is  likewise  closed;  it  thus  re¬ 
presents  a  second  independent  clock.  However,  according  to  the  postulate 
PI,  the  synchrony  of  these  clocks  can  be  effected  only  if  the  passages 
through  the  cycles  are  causally  (conflict-freely)  dependent  on  each 
other.  Thus  if  we  recognize  PI,  then  varying  according  to  the  particular 
modus  observandi ,  either  the  word  ’interrogate’  or  the  terra  'span  of 
time'  will  lose  its  meaning  in  this  reference. 

The  same  considerations  would  apply  for  communication  with  NB. 

'Then  C'  would  mean,  then,  that  (on  fulfillment  of  the  total  condi¬ 
tion  'If  A  or  B')  a  signal  is  given  at  C.  Possible  feedback  signals  from 
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NC  may  well  belong  to  other  parts  of  a 
total  plan;  these  other  parts  would  be 
connected  to  the  observed  plan  by  means 
of  a  parallelity  operator  signifying 
that  not  only  is  the  observed  plan  to  be 
executed  but  the  totality  of  remaining 
partial  plans  as  well.  The  activation  of  such  composite  plans  is  brought 
about  by  way  of  a  node  W. 

We  must  now  analyze  the  plan  'If  A  or  B,  then  C'.  This  analysis  will 
consist  in  finding  a  net  representation  of  the  (colloquial)  'or'  from 
which  an  exact  operational  definition  of  'or'  can  be  had.  This  functor 
does  not  in  general  correspond  to  the  disjunction  of  the  two-valued  pre¬ 
dicate  calculus,  which  (as  is  the  case  for  all  of  the  functors  of  this 
calculus)  can  be  represented  conflict-free ly. 

Below  (Figure  8)  we  give  a  conflict-free  representation  of  disjunc¬ 
tion.  We  have  not  chosen  the  'simplest'  representation  (as  regards  the 
number  of  nodes,  actions,  or  locations),  but  rather  we  give  one  from 
which  it  may  be  seen  how  for  any  given  predicate  function  a  net  can  be 
constructed.  In  essence  the  net  says  the  following:  After  the  activation 
of  the  total  plan  both  NA  and  NB  are  activated.  The  partial  information 
obtained  through  the  interrogation  is  stored,  and  ready-signals  are  de¬ 
rived  from  the  process  of  storage;  when  both  ready-signals  (one  derived 
from  the  NA  interrogation,  the  other  to  the  NB  interrogation)  are  pre¬ 
sent,  the  'items'  of  stored  information  are  coupled  according  to  the 
truth-table  for  disjunction  and  read  out. 

Thus,  for  example,  although  the  presence  of  a  'yes'  answer  from  NA 
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alone  defines  the  answer  and  would  entitle  us  to  the  decision  yes-NC,  this 
net  must  nevertheless  wait  for  the  answer  from  the  interrogation  of  NB. 
This  corresponds  exactly  to  the  formal  prescriptions  for  the  evaluation 
of  a  truth  table  when  its  inputs  are  assigned  directly  to  the  possible 
answers  (from  NA  and  NB). 

The  noticeable  complexity  of  the  net  is  explained  by  our  selection 
of  switching  elements  that  are  subject  to  no  more  than  two  actions  (each). 
Jumping  ahead  somewhat  (see  Section  5) ,  we  mention  the  fact  that  this  com¬ 
plexity  can  be  circumvented  by  the  selection  of  a  single  switching  element 
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and  that  this  choice  coincides  with  the  requirements  of  postulate  P2.  We 
emphasize  once  again  the  arbitrariness  of  all  constructions  in  this  sec¬ 
tion;  the  constructions  are  meant  not  as  suggestions  for  circuits,  but 
rather  as  temporary  means  of  proof. 

A  general  remark  for  the  understanding  of  net  constructions:  The  re¬ 
presentation  of  nets,  as  in  Figure  8  and  in  what  follows,  is  meant  as  an 
abbreviated  form  of  a  proof  for  the  existence  of  a  derivation  of  certain 
forms  of  communication  from  simpler  ones  produced  by  means  of  axioms  and 
definitions,  i.  e.  from  actions.  Corresponding  to  the  elementary  charac¬ 
ter  of  the  relations  represented,  a  formal  elaboration  of  such  a  proof 
would  be  extremely  voluminous.  Similarly,  even  a  fairly  exact  colloquial 
explanation  would  be  too  long  to  be  clear. 

On  the  other  hand,  however,  we  do  not  wish  to  appeal  to  theorems 
with  universal  quantifiers,  in  order  that  the  proofs  be  verifiable  in  the 
strictest  constructive  sense.  We  shall  therefore  content  ourselves  with 
the  statement  of  a  method  of  not  only  producing  full  proofs  but  also  of 
attaining  to  some  insight  into  the  workings  of  a  net. 

We  imagine  that  the  execution  of  the  actions  ,  be  under  our  control, 
but  not  in  such  a  way  that  the  actions  depend  on  additional  locations,  but 
rather  as  if  we  were  to  assume  the  rdle  of  the  node  ourselves,  so  to  say. 
We  then  enumerate  all  the  sequences  of  possible  actions  of  the  net  and 
determine  their  dependence  on  our  own  actions;  this  we  do  for  each  node 
of  the  finite  net. 

The  following  •operational'  representation  corresponds  to  certain 
interpretations  of  the  many-valued  predicate  calculi,  for  example  to  the 
following  truth  table  for  *or* : 
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A  or  B 
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We  interpret  the  inputs  to  the  truth  table  as  follows: 

T:  the  result  of  a  given  experiment  is  a  (’yes') 

F:  the  result  of  a  given  experiment  is  b  ('no’) 

(where  a  and  b  are  mutually  exclusive) 

U:  the  result  of  a  given  experiment  is  unknown. 

In  order  to  avoid  complications,  we  assume  that  the  total  plan  pro¬ 
vides  for  only  a  single  evaluation  of  the  condition  'If  A  or  B'.  Since 
it  must  be  decided  by  some  node  whether  it  is  A  or  B  or  both  that  repre¬ 
sents  the  cause  of  the  activation  of  C,  the  net  evaluating  the  condition 
will  nevertheless  contain  a  conflict.  By  way  of  an  example,  if  the  action 
of  making  A  alone  the  cause  of  C  has  been  enabled  but  not  yet  executed, 
there  is  nothing  to  prevent  B  from  appearing  before  the  action  takes 
place.  Therewith,  either  a  further  action  at  the  same  location  is  enabled 
or  else  the  first  action  is  made  inapplicable  before  execution;  in  either 
case  there  is  a  conflict. 

The  nets  below  (Figures  9  and  10)  reproduce  the  above  truth  table, 
but  they  also  say  somewhat  more  in  that  they,  in  characteristically  diff¬ 
erent  ways,  distinguish  more  exactly  the  locations  of  possible  conflict, 
i.  e.  they  give  two  processes  for  the  evaluation  of  the  truth  table. 

In  the  first  case  (Figure  9)  NA  and  NB  have  (speaking  quite  col¬ 
loquially)  equal  say  in  the  evaluation.  The  critical  objects  of  the  two 
possible  conflicts  lie  on  the  ^  g  locations.  The  conflicts  involve 
the  actions  of  the  S-nodes. 
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In  the  second  case  the  critical  objects  lie  at  the  input  locations 
of  the  encircled  V-node,©.  Here  there  is  a  priority  of  an  NB-yes  answer 
and  the  conflicts  involve  the  actions  of  ©  and  U.  The  S-node  is  to  in¬ 
sure  that  NC  be  activated  no  more  than  once. 
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Two  things  should  be  clear  from  these  examples:  1)  the  necessity  of 
admitting  conflicts  in  the  exact  representation  of  certain  forms  of  com¬ 
munication,  and  2)  the  difficulties  encountered  from  the  beginning  in  the 
construction  of  conflict-free  nets. 

We  now  wish  to  construct  a  conflict-free  net  that  will  be  capable 
of  communication  and  will  correspond  to  a  Turing  machine.  We  plan  the 
construction  in  such  a  way  that  that  it  will  at  the  same  time  become  clear 
how  one  can  design  conflict-free  nets  1)  for  arbitrary  switching  mechan¬ 
isms  of  fixed  finite  size,  and  2)  for  arbitrarily  extensible  memories. 

Here,  too,  we  shall  be  concerned  less  with  the  number  of  nodes  or  loca- 
/ 

tions  than  with  generalizability. 

We  have  at  our  disposal  the  node  types  of  Figure  11;  using  these  we 
Fig.  11 

Q~  T  W  V 


Q  T  W  U 


shall  define  a  new  'unit'  Ml  (Figure  12)  as  follows: 

N1  (a  b  c  d)  =  ft  (x  z  a) 

V  (x  y  d) 

S  (z  b  c  y) 


Nl,  abbreviated  as  shown  in  Figure  13,  is  used  primarily  as  a  part  of  N2, 


N1  1J 

.  A 

X 

►  V 

- 0-z-0-  c 

lb 

Fig.  12 

W 

Fig.  13 
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shown  in  Figure  14.  N2  can  serve  to  produce 
the  temporary  connection  of  several  action 
chains  (for  example,  for  activating  a  net  Ni 
from  various  locations,  as  in  Figure  14). 

It  is  required,  however,  that  at  any  given 
instant  at  most  one  of  the  action  chains  be 
active;  this  condition  is  to  be  fulfilled  by 
the  environment  of  N2.  Such  conditions  we 
shall  express  by  means  of  formulas  of  a  com¬ 
binatorial  system  CS3,  from  which  the  concept 
•form  of  communication'  will  receive  an  exact 


meaning.  Combinatorial  system  CS3  we  define  as  follows; 


Axiom;  I 

Productions;  Z  ■+  V  Z  Z 
Z  +  /ZZ 
Z  +  5ZE 

z  -*•  #  z 

Z  *►  0 
Z  -►  a"\ 


(choice  or  conflict) 

(causality) 

(paralleiity) 

(iteration,  signal  cycle;  'clock') 

(contradiction;  insufficiency  of 
the  net) 


Z  -*■  b  >  enumeration  of  the  elements  of  X 


The  CS3  formulas  are  to  describe  the  temporal  and  structural  'con¬ 
nection  of  a  net  with  its  environment  (to  the  extent  that  this  connection 
can  be  expressed  by  events  in  the  peripheral  locations  alone) .  This  con¬ 
nection  we  shall  call  a  fom  of  communication  for  the  location  concerned. 
By  the  term  event  we  shall  mean  the  appearance  of  a  distinguished  object. 
X  we  shall  define  to  be  the  set  containing  all  and  only  the  possible 
peripheral  events  of  a  net. 
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We  make  the  requirement  initially  (with  no  essential  loss  of  gener¬ 
ality)  that  the  observed  peripheral  locations  become,  by  virtue  of  the 
communication,  oriented  locations.  The  peripheral  events  then  separate 
into  two  non-overlapping  classes:  input  events  and  output  events  (dual 
interchange  possible) . 

We  shall  forego  any  rambling  colloquial  explanation  of  the  inter¬ 
pretation  of  CS3  because  it  is  analogous  to  that  of  CS1  with  the  differ¬ 
ence  that  communication  foims  can  now  be  not  only  sequences  of  events 

but  also  combinations  of  events  (because  of  the 
parallelity  operator).  We  shall  explain  by  means 
of  an  example:  /  a  V  b  c  (as  in  Figure  15)  spec¬ 
ifies  the  communication  form  ( \C-form )  of  an  inform¬ 
ation  source.  To  keep  to  this  C-form  is  to  give  the 
environmental  net  a  structure  that  makes  it  im¬ 
possible,  after  one  interrogation  to  (of)  NA,  to  give  yet  another  before 
the  answer  to  the  first  has  appeared;  we  require  further  that  NA  give  no 
answer  without  being  interrogated,  and  that  it  give  exactly  one  answer 
per  interrogation  and  not  both  answers  ’simultaneously’  or  ’serially’  to 
the  same  interrogation. 

#  a  is  a  C-form  of  Q  and  ($ 

X  /  a  b  is  a  C-form  of  T  and  T 

¥:  /  §  a  b  a  is  a  C-form  of  W  (and  of  W) 

X  /  a  §  b  o  is  a  C-form  of  W  (and  of  W) 

#  V  //ad/bc-xrlbd  is  a  C-form  of  N1 
Cl  :*/VVabcVVdef  is  a  C-forra  of  (N2  +  Ni) 

C2:  *  V  V/ad/be/of  is  a  C-foxm  of  (N2  ♦  Ni) 
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Obviously  C2  says  more  than  Cl;  if  we  are  familiar  with  C2  then  we 
can  derive  Cl  from  it,  but  the  formalism  of  the  derivation  lies  beyond 
the  limits  set  for  this  work.  We  would  mention  only  that  via  the  formulas 
of  CS3  there  can  be  defined  a  non-symmetric,  reflexive,  transitive  rela¬ 
tion  of  ’being  contained  in’,  as  here:  C2  D  Cl.  We  shall  call  C2  the 
narrower  C-form,  Cl  the  broadev\  here  we  shall  not  investigate  the  alge¬ 
bra  of  C-forms  any  further. 

We  wish  to  construct  a  net  that  has  the  following  C-forra: 

C3  :X/V/ab/X/cd/abV/ab/*/ce/ab  „ 
and  therewith  the  broader  C-form: 

Xv/ablcVde 

The  narrower  C-form  says  in  words  that  the  net  to  be  constructed  has  a 

one-bit  memory  cell  that  can  be  interro¬ 
gated  by  activating  c;  the  result  of  an 
interrogation  is  d  if  the  total  number  of 
passes  through  /  a  b  is  even,  e  if  it  is 
odd.  The  net  N3  (Figure  16)  does  what  is 
required.  There  it  is  to  be  recognized 
clearly  that  the  concept  ’state  of  N3' , 
which  is  characterized  by  the  object  at 
the  location  marked  ’x' ,  is  bound  to  the 
communication  form  under  which  we  observe  the  net. 

We  also  construct  another  type  of  memory  cell,  N4  (shown  in  Figure 
17),  which  can  be  set  without  counting  the  passes  (mod  2)  through  /  a  b\ 
this  net  has  the  broad  C-form 


*VjVabd/c1&f 


t 


-56- 


(C-forms  in  which  every  peripheral  event  is  named  exactly  once  may  be 
called  normal.)  Since  the  net  consists  of  a  combination  of  tokens  of  Nl, 
N2,  and  N3,  we  specify  in  the  diagram  only  the  additional  nodes.  A  C-form 
corresponding  to  C3  that  would  make  7  e  f  explicit  can  be  found  using 
the  same  considerations  as  in  the  case  of  C3.  We  shall  make  use  only  of 
normal  C- forms  henceforth. 


Further  we  have  the  net  types  N5  (Figure  18)  and  N6  (Figure  19), 
which  allow  respectively  for  the  interrogation  and  setting  of  memory 
contents  from  several  (here  2)  signal  cycles.  N5  has  the  normal  C-form: 

XVV/Vabc/dVfg  /  e  V  h  i 

~ < i  ~  ‘  '  ~  \  ___  ii  ^ 

Setting  Readout  1  Readout  2 

Here  we  have  already  oriented  the  peripheral  locations  in  the  diagram, 
although,  strictly  speaking,  they  receive  their  orientation  only  when 
the  net  is  built  into  a'  larger  net;  we  have  done  this  to  increase  under¬ 
standing  and  to  express  the  fact  that  the  C-form  under  which  we  observe 
the  net  requires  this  orientation. 
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The  memory  net  N6  (Figure  19)  has  rather  the  character  of  a  one-bit 
buffer,  as  follows  from  the  C-form: 

%/VjVabc/Vefd/gVhi 

*> — v — t / 

Setting  1  Setting  2  Readout 

Setting  (from  either  the  right  or  the  left)  and  interrogation  must  take 
place  alternately,  beginning  with  a  setting.  Clearly,  however,  we  can 
also  build  memories  after  the  pattern  of  net  N4  that  are  not  subject  to 
this  limitation. 


In  order  to  put  a  general  automaton  into  net  form,  then,  we  must 
first  1)  establish  a  suitable  communication  form,  and  2)  select  one  of 
the  various  forms  used  for  the  representation  of  automata.  As  is  known, 
it  is  no  limitation  of  generality  to  admit  as  input  and  output  of  an  in¬ 
formation  processor  only  alphabets  with  two  symbol  types  instead  of 
arbitrary  finite  alphabets.  We  assign  to  the  symbol  types  the  four  peri¬ 
pheral  locations  of  a  net  (a,  bt  o,  and  d) .  The  timing  of  the  automaton 
as  well  as  other  arrangements  as  to  the  way  in  which  the  automaton  func¬ 
tions  can  be  expressed  by  the  normal  C-form: 


C7:  X  /  V  a  b  V  a  d 
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The  development  of  the  C-form  after  the  V  leads  to  a  narrower  C-form 
that  reproduces  the  behaviour  of  a  special  automaton. 

As  the  defining  representation  of  an  automaton  we  choose  the  state- 
transition  graph  or  the  table  belonging  to  it  (which  may  be  incompletely 
filled-in) . 

with  i  *  7  o  d 

ok 

qjk  =  qV  ' 

(1  <  l  i  n) 


We  give  the  interpretation  of  an  arbitrary  line  qm  b  a  q^  as  follows: 

If  the  automaton  is  in  state  qm  and  at  the  same  time  receives  the  input 
signal  b ,  then  it  emits  the  signal  c  and  goes  over  into  state  q ^  for 
the  next  time  period. 

For  each  symbol  type  qm  that  appears  in  the  table  (not  for  each  sym¬ 
bol  token  qm )  we  introduce  a  copy  of  net  N7  (Figure  20) .  We  connect  these 
copies  of  N7  with  each  other  in  the  sequence  in  which  the  q^'s  are  initi¬ 
ally  encountered  in  reading  the  table,  and  as  soon  as  we  would  specify 
that  there  is  to  be  no  further  extension  of  the  net  we  'close'  the  last 
peripheral  locations  of  the  type  a”,  b"t  o\  and  d"  by  means  of  Q-nodes. 

The  meaning  of  this  closure  is  primarily  'denial  of  accessibility',  that 
is  of  possibilities  of  communication.  This  closure  is  not  merely  a  formal 
act  with  the  purpose  of  observing  certain  arbitrary  conventions  regarding 
our  constructions,  for,  obviously,  by  the  execution  of  this  closure, 
peripheral  locations  of  the  'constructing  subject'  are  freed,  and  the 
subject  therewith  attains  to  new,  nonredundant  communication  possibilities. 
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The  full  gravity  of  such  considerations  is,  of  course,  felt  only  in  the 
complete  formalization  of  the  construction  process;  we  present  them  here 
only  in  order  to  avoid  misunderstanding  regarding  the  meaning  of  closure. 


By  the  process  of  coupling  there  arises  an  N7-chain  the  members  (or 
’links')  of  which  are  uniquely  assigned  to  the  qm's  in  the  table.  The 
particular  qm  assigned  to  a  given  N7-link  will  be  called  the  mark  of 
that  link.  We  connect  the  N7-chain  to  the  automaton  after  the  following 
prescription.  For  each  line  of  the  table  (for  example,  the  line  reading 
qm  b  o  q we  produce  exactly  one  V-node  and  connect  it  as  follows: 
the  one  input  of  the  V-node  is  identified  with  the  b '  output  of  the  N7- 
net  that  has  the  mark  qm\  the  second  input  remains  free;  the  output  of 
the  V-r.ode  is  identified  with  the  a  input  of  the  N7-net  that  has  the 
mark  q^t  or  (if  that  input  is  no  longer  free)  with  the  free  input  of  the 
last  V-node  to  be  attached  to  the  o  input  or  to  the  V-node- chain  of  that 
input.  And  so  mutatis  mutandis  for  qm  a  a  q^3  qm  a  d  q^t  and  qm  b  d  q^% 
After  treating  the  last  line  of  the  table  we  close  all  peripheral  loca- 
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■  Above  it  was  presupposed  that  any  given  symbol  pair  q^i  (for  present 

state  and  present  input,  respectively)  would  appear  in  the  table  at  most 
once  (as  is  generally  required  of  automata) .  We  can  free  ourselves  of 
this  prerequisite,  however,  by  replacing  the  above  connection  prescrip¬ 
tion  with  a  matrix  prescription,  a  prescription  so  simple  that  we  shall 
give  only  an  outline  of  it.  Next  to  the  N7- chain  (of  n  links)  we  lay  a 
2 n  x  2 n  'matrix*  of  locations  formed  of  2»(2n)2  locations  that  are  to 
be  oriented  (see  Figure  21).  The  row  inputs  we  assign  to  the  a*  and  b' 
outputs  of  the  N7-chain;  the  column  outputs  we  assign  to  the  o'  and  d 1 
inputs.  Now  for  each  row  we  introduce  exactly  one  19-node  and  one  V-node 
as  shown  in  Figure  22.  After  treating  the  last  line  of  the  table  we 
close  the  'gaps'  between  vicinal  peripheral  locations  in  the  interior 
by  means  of  T-nodes;  the  remaining  peripheral  locations  we  close  by  means 
of  Q-nodes.  With  this  sort  of  coupling  conflicts  can  arise,  some  corre- 
ponding  to  'sneak  paths*  of  relay  engineering,  but  others  of  a  more 
general  type.  On  the  other  hand,  even  if  the  tables  do  not  fulfill  the 
above  prerequisite,  under  certain  circumstances,  nets  can  arise  that  are 
conflict-free  under  the  C-form  C7.  In  order  that  fact  can  be  judged  cor¬ 
rectly  we  mention  without  proof  that  for  every  net  capable  of  communica¬ 
tion  there  exists  a  C-form  that  permits  conflicts  in  communication. 


rvv'v- 
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We  shall  take  this  matrix  representation  of  the  partial  nets  of  an 
automaton  as  basic  in  what  follows  (even  in  the  construction  of  a  net 
for  a  universal  Turing  machine  capable  of  communi cation)  with  the  one 
difference  that  not  all  of  the  peripheral  locations  that  were  closed  with 
Q-nodes  will  be  so  closed.  In  this  way  we  shall  be  able  to  communicate 
with  the  machine  via  the  peripheral  locations  of  the  matrix  (and  even  in 
irregular  languages,  at  that,  and  this,  at  our  discretion,  with  or  with¬ 
out  conflict) . 

We  shall  not  concern  ourselves  with  the  fixed  (built-in)  universal 
program,  for,  as  is  known,  it  can  be  put  in  the  form  of  a  finite  table. 

We  shall  imagine  this  table  to  be  supplemented  by  fixed  standard  pro¬ 
grams  (in  the  programming  language  of  Turing  machines,  for  input,  out¬ 
put,  tape  erasure,  and  state  interrogation  -  see  [1])  and  put  into 
matrix  form.  There  remains,  then,  the  task  of  putting  the  modus  operandi 
of  the  reading  head  and  the  tape  into  net  form. 

Here  it  is  no  longer  a  question  of  organizing  for  the  solution  of 
a  total  problem  a  prespecified  number  of  elements  capable  of  actions; 
rather  we  must  find  a  form  of  organization  in  which  unboundedly  many 
elements  can  participate,  but  one  that  can  nevertheless  be  described  with 
finite  means  and  of  such  type  that  each  element  communicate  with  only  a 
uniformly  limited  number  of  immediately  vicinal  elements  (which  are  al¬ 
ways  the  same  ones)  with  uniformly  limited  means. 

We  can  prove  the  existence  of  such  an  organization  form  only  by 
construction.  Since  the  'periphery'  of  the  reading  head  with  the  tape  is 
to  communicate  with  the  locations  a,  b ,  c,  and  d  of  an  automaton,  the 
head  must  have  the  C-form  X  /  V  o  d  V  a  b  (designating  the  locations 
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to  be  identified  with  each  other  by  means  of  the  same  symbol).  We  first 
ask  ourselves  whether  this  form  is  sufficient.  7  a  b  is  sufficient  in 
all  cases  for  the  symbols  to  be  read  from  the  tape  together  with  their 
temporal  delimitation;  it  is  known  that  the  tape  of  a  Turing  machine  re¬ 
quires  only  two  symbol  types  (’blank'  and  'marked',  or  'zero'  and  'one'). 
We  must  also  map  the  following  symbols  onto  V  o  d  : 

l:  read  the  next  symbol  to  the  left 
r:  read  the  next  symbol  to  the  right 
2 :  replace  the  symbol  being  read  by  'zero' 
e:  replace  the  symbol  being  read  by  'one' 

Such  a  mapping  is  possible  as  follows:  since  on  the  basis  of  the  con¬ 
struction  of  net  N7  it  is  known  at  all  times  what  the  last  symbol  read 
was,  we  can  combine  z  and  e  into  u  and  w: 

u :  leave  the  symbol  being  read  unchanged 
w :  replace  the  symbol  being  read  by  its  dual. 

We  shall  define: 

c  =  I  ,  and  d  =  /  w  r  , 
so  that  we  thus  have  the  following  subprogram: 

l  =  o 

r  =  /  /  d  a  d 
u  =  /  /  /  d  o  d  o 
w  =  /  d  a 

The  programming  language  for  Turing  machines  is  therewith  translated  in¬ 
to  the  language  of  automata,  and  the  four-place  normal  C-foim 
X/VcdVab  is  proven  sufficient. 

Above  we  have  already  seen  descriptions  for  a  one-bit  memory  (N5) 
that  could  be  interrogated  by  different  signal  chains,  and  for  a  suitable 
one-bit  buffer  (N6) ;  we  shall  now  make  use  of  these.  (It  is  easily  seen 
from  the  construction  how  one  might  design  an  n-bit  memory  or  buffer.) 
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Our  plan,  then,  is  to  translate  the  reading  head  together  with  the 
tape  field  being  read  into  a  net  N8,  and  each  of  the  two  remaining 
'halves'  of  the  tape  into  a  net  N9  (as  in  Figure  23).  If  we  imagine  N8 


to  be  removed,  then  there  remain  two  memories  of  a  special  type,  the 
bounded  forms  of  which  are  well-known  in  programming,  namely  push-down 
(PD)  stores  (or  automata).  As  in  any  general  memory,  so  also  in  the  PD 
store  one  has  the  following  communication  plan: 

Cll:  XV /cVde/Vhig  , 

in  which  V  h  i  is  the  information  to  be  stored,  c  the  'fetch'  signal 
for  the  last  information  stored,  V  d  e  the  answer  to  the  interrogation 
c,  and  g  the  ready  signal. 

However,  according  to  the  results  of  Section  2,  it  is  impossible 
for  there  to  be  such  a  simple  communication  form  ruling  in  all  of  the 
completely  separate  sections  (as  'Section  1'  in  Figure  23);  otherwise  we 
could  interpret  the  C-forra  as  a  CS1  formula,  and  we  should  have  to  show 
that  there  exists  a  finite  CS1  formula  that  reproduces  the  PD-principle, 
which  is  obviously  recursive.  It  is  therefore  necessary  for  the  C-forms 
of  the  sections  to  contain  a  noneliminable  parallelity  operator. 

There  are  many  possibilities  for  the  intuitive  selection  of  C-forms 
for  the  sections;  their  transduction  can  be  effected  with  the  aid  of  a 
calculus  that  we  shall  not  describe  here.  We  shall  state  a  C-forra  direct 
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ly  that  contains  only  a  single  example  of  the  5-operator  and  therefore 
illustrates  quite  clearly  the  noneliminability  of  the  5: 

C9:  *  /  5  7  /  //  /cVdem  Ik  /  ///Vhigmlfab  . 

In  contradistinction  to  corresponding  'synchronous*  constructions,  this 
C-form  makes  it  possible  for  an  action  chain  of  uniformly  limited  length 
to  proceed  to  the  net  periphery  from  each  activation  of  o  or  V  h  i,  with 
no  dependence  on  the  length  of  the  push-down  store.  In  Figure  24  we 
specify  a  net  N9  that  corresponds  to  C9;  N9’  is  produced  from  N9  by  re¬ 
flection  (not  by  rotation).  Each  N9-N9*  pair  of  nets  communicating  with 
each  other  satisfies  the  specified  C-foxm  conflict-freely  with  respect 
to  both  12- tuples  of  peripheral  locations.  Proceeding  from  the  periphery 
of  such  a  push-down  store,  we  can  separate  the  C-form 

CIO:  *  V  /  c  V  d'e'/  V  hi  g' 

from  the  C-form  C9  by  means  of  the  net  specified  in  Figure  25. 


It  thus  appears  that  by  means  of  such  supplementation  the  5-operator 
can  be  eliminated  by,  proceeding  from  the  periphery,  intercoupling  an 
N10-N10'  pair  between  successive  N9-N9'  pairs  (moving  from  one  N9-N9' 
pair  to  the  next).  If  we  assume  that  the  PD-store  has  a  finite  length, 
then  this  process  will  eventually  terminate,  and  the  memory  will  then 
consist  of  a  chainof  Nil  nets  (Figure  26),  where  the  sections  between 
the  Nil’s  will  have  the  5-free  C-form 


Cll;  XV/cVde/Vhig  . 
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The  fundamental  difference  between  these  two  types  of  PD-automaton 
lies  in  the  following:  if  an  interrogation  is  directed  to  the  periphery 
of  an  Nil  chain  meant  for  iterative  use,  then  it  is  impossible  for  an 
answer  to  appear  until  an  action  chain  has  gone  through  all  the  copies 
of  Nil;  further,  the  end  of  the  memory  must  be  occupied  by  a  communica¬ 
tion  partner  (net)  with  the  C-form  Cll.  If  this  communication  partner 
has  a  plan  that  can  be  described  by  a  finite  net  with  the  peripheral 
form  Cll,  then  this  net  must  either  be  analyzable  into  separate  nets,  or 
contain  conflicts,  corresponding  to  the  free  choice  (so  to  say)  of  the 
partner  at  the  input  of  the  chain,  in  the  valuation  of  V. 

As  an  example  we  may  cite  the  following  plan  of  the  end-partner: 
•Received  information  (i.  e.  the  information  V  e  d  released  from  the  PD- 
store)  is  lost;  for  any  interrogation  by  the  memory,  the  answer  h  is  to 
be  given  (as  in  the  left-shift  of  a  computing  register  zeros  are  added 
to  the  right,  and  in  a  right-shift  the  information  is  lost).*  Translated 
into  the  language  of  C-forms,  this  means  that  the  valuation  of  the  V's 
for  the  communication  partner  is  the  following: 

*  Vl  /  c  Vi  d  e  /  Vi  h  i  g  . 

and  V3  are  under  the  control  of  the  input-partner;  this  is  inherent 
in  the  sense  of  the  memory  utilization:  one  has  the  choice  of  either 
storing  or  interrogating,  and  if  one  chooses  storing,  then  there  is  a 
choice  in  what  is  to  be  stored.  ?2  brings  about  an  accessing  of  inform¬ 
ation,  and  its  valuation  is  not  subject  to  the  control  of  the  input- 
partner. 

In  the  net  that  is  to  represent  the  above  plan  of  the  end-partner 
the  situation  is  reversed:  only  Vj  is  under  its  control.  The  plan  requires 


-67- 


that  /  q  7  d  e  separate  into  /ad  and  /  0  e  (i.  e.  Q(«)).  Further, 

#  V  •••  /  ...  separates  into  X  /  •••  and  X  /  •  ••.  Therefore,  a  signal 
cycle  beginning,  for  example,  with  o  at  the  input  can  be  closed  conflict- 
freely  only  via  /  o  d  at  the  output,  and  an  imagined  'infinite'  Nil-chain 
could  not  possibly  work. 

In  the  case  of  the  PD-store  consisting  of  only  N9-N9'  pairs  the 
situation  is  different.  For  every  activation  at  the  input-periphery  a 
'wave'  of  actions  propagates  to  the  end,  a  wave  that  carries  with  it  the 
combined  information  from  V*  and  V3.  It  is  only  by  means  of  the  6-operator 
(i.  e.  by  the  introduction  of  combined  W-ft-cycles)  that  it  is  possible  to 
make  the  desired  feedback  signals  independent  of  the  propagation  of  the 
wave  and,  therewith,  of  the  length  of  the  memory. 

The  only  thing  lacking,  then,  is  the  construction  of  the  reading 
head  of  a  Turing  machine  together  with  the  tape  field  being  observed; 
this  is  accomplished  by  the  net  N8  shown  in  Figure  27. 
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The  construction  of  a  net  representation  for  the  flow  of  information 
in  a  Turing  machine  is  therewith  concluded.  There  remain  to  be  discussed 
the  conditions  on  the  ends  of  the  tape,  for  there,  too,  the  C-form  C9 
must  be  adhered  to.  However,  since  the  tape  may  lose  no  information, 
and  since  nothing  has  been  said  about  the  coupling  of  the  peripheral 
locations  at  the  end  of  the  tape,  C9  is  fulfilled  trivially,  that  is 
by  the  absence  of  signals. 

This  necessity  now  gives  us  a  prescription  for  the  construction  of 
such  memories.  Ibis  prescription  is  distinguished  by  the  fact  that  it 
has  a  finite  cycle  and  that  a  ’run1  through  this  cycle  is  completely 
independent  of  the  work  cycle  doing  the  constructing  (here  the  tape). 

That  means  in  this  case  that  the  constructor  (see  [2],  p.  299)  does  not 
have  to  communicate  with  the  user  of  the  machine. 

In  the  construction  of  a  Turing  machine  one  must  therefore  produce, 
in  addition  to  a  finite  net,  two  identical  N9-N9'  constructors ;  the  activ¬ 
ation  of  the  constructors  simultaneously  ends  the  possibility  of  communi¬ 
cating  with  them.  Taking  the  situation  of  the  lefthand  half  of  the  tape 
illustrated  in  Figure  28  as  a  beginning,  the  plan  of  a  constructor  will 
have  to  read  as  follows: 

Cl:  #  /  /  /  /  /  2>  a  @  &  m  @  , 
in  which  (n$^  is  a  constructive  C-foxrn  signifying  the  production  of  an 
N9  net.  (In  order  to  define  this  we  should  have  to  extend  the  range  of 
the  concepts  used  up  to  this  point  in  order  to  describe  the  production 
of  new  locations  and  the  process  of  connexion.  Instead  we  shall  mention 
only  that  the  formal  description  is  finite  in  all  cases,  and  that  the  de¬ 
scription  would  have  little  value  without  a  statement  of  interpretation. 
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After  a  run  through  Cl  the  same  situation  arises;  this  fact  is  the 
justification  of  the  ^-operator.  The  essential  parts  of  Cl  are  /  b  a 
and  /  l  777.  Their  interpretation  clarifies  the  independence  of  the  con¬ 
structor.  The  nets  N9  and  N9'  are  constructed  in  such  a  way  that  they 
contain  only  one  distinguished  bit:  the  ’null’  information  in  N6.  This 
bit  is  not  characteristic  of  the  net,  for  after  the  determination  of 
the  net  it  can  be  shifted  and  replaced.  On  the  other  hand,  by  means  of  b 
a  bit  is  introduced  to  the  net  N9  (or  N9’)  that  is  always  maintained  in 
the  net  and  enables  it  to  be  activated  from  the  right.  This  character¬ 
istic  distinguished  bit  (the  eigenbit)  is  introduced  by  the  event  b,  is 
confirmed  by  means  of  a  for  the  constructor  to  the  left,  and  is  found 
at  the  location  x  between  W  and  W  exactly  as  often  as  the  C-form  is  run 
through n  times  (n  >0).  Its  position  at  any  given  time  corresponds  to 
the  observed  position  of  the  C-form.  The  course  of  the  eigenbit  through 
the  C-form  is  analogous  to  the  algorithm  for  the  evaluation  of  CS2 
formulas  (v.  p,  19). 

The  proof  that  the  push-down  automaton  is  capable  of  functioning 
conflict-freely,  as  well  as  insight  into  the  modus  operandi  of  the  memo¬ 
ry  is  to  be  had  from  an  examination  of  the  characteristic  paths  of  the 
eigenbits  (as  shown  in  Figure  29).  Figure  29  is  obtained  from  the  memory 
structure  by  the  contraction  of  the  /’s  and  the  V's.  There  is  always 
exactly  one  eigenbit  in  each  cycle.  If  a  cycle  with  no  eigenbit  were  to 


be  added  to  the  end,  it  would  in  no  way  influence  the  activity  of  the 
rest  of  the  chain.  Therefore  one  can  undertake  constructions  on  this 
cycle  that  correspond  exactly  to  the  productions  of  CS3,  and  as  soon  as 
the  constructions  are  concluded  the  cycle  may  be  given  its  eigenbit, 
after  which  time  it  can  take  part  in  the  activities  of  the  chain,  with¬ 
out,  however,  disturbing  the  construction  on  the  next  cycle(s)  (because 
its  eigenbit  can  not  leave  it) . 


Hie  topologization  of  the  information  flow  in  a  Turing  machine 
under  consideration  of  thtf  postulate  PI  is  therewith  completed.  In  par¬ 
ticular  it  has  been  shown  that  the  C-forra  of  the  reading  *  /  V  o  d  V  a  b 
and  therewith  the  C-form  of  the  periphery  of  the  universal-program 
matrix  is  independent  of  the  activity  of  the  constructors  (and  there¬ 
with  of  the  length  of  the  tape),  so  that  the  total  net  (that  is  to  say, 
machine  +  constructors)  contains  no  conflicts. 

Therefore  there  exists  no  conflict-free  experiment  (algorithm)  on 
the  program  periphery  of  the  Turing  machine  that  enables  one  to  estab¬ 
lish  the  length  of  the  tape.  In  this  sense,  by  virtue  of  the  detachment 
of  the  constructors,  the  specified  net  is  equivalent  to  an  infinite  net; 
that  is  to  say,  it  is  in  the  position  to  recognize  irregular  messages. 
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S.  Formalization  and  Generalization 

The  construction  of  a  net  for  a  Turing  machine  has  served  us  prim¬ 
arily  in  showing  that  the  theory  of  synchronous  automata  is  contained  in 
a  more  general  theory  of  communication  forms.  We  must  now  speak  of  the 
applicability  and  further  development  of  such  a  theory.  As  was  mentioned 
in  Section  1,  the  applications  that  were  the  impetus  for  this  investiga¬ 
tion  are  to  be  found  in  methods  for  the  design  and  programming  of  in¬ 
formation-processing  machines. 

Certain  logical  fundamentals  of  these  applications  have  been  pro¬ 
vided  in  Section  4  by  means  of  explicit  patterning.  We  may  now  ask  wheth¬ 
er  it  is  possible  to  interpret  the  formalism  of  the  nets  in  some  suitable 
way,  and  whether  there  exist  material  objects  that  have  exactly  the  same 
behaviour  as  the  intuitively-introduced  switching  elements  of  Section  4. 

It  is  immediately  clear  that  any  of  the  conflict-free  nets  illustrat¬ 
ed  could  be  realized  by  imagining  the  nodes  to  be  occupied  by  persons  who 
have  the  task  of  acting  in  accordance  with  the  actions  of  the  particular 
node  that  they  occupy.  The  N-structure  of  the  net  is  then  given  by  a 
spatio-topological  structure  of  the  communication  possibilities  between 
the  various  persons.  It  is  shown  therewith  that  conflict-free  nets  re¬ 
present  in  all  cases  a  workable  form  of  organization  with  complete  speci¬ 
fication  of  the  information  flow. 

In  Section  4  we  selected  switching  elements  with  functions  that 
lie  close  to  our  understanding.  However,  to  prove  the  general  interpret- 
abili'ty  in  the  physical  domain  it  would  be  necessary  to  express  in  the 
language  of  nets  all  of  the  primitive  conceptual  foundations  of  physics. 
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Such  a  task,  however,  would  go  far  beyond  the  framework  of  this  investi¬ 
gation;  further  it  is  seen  to  be  far  more  to  the  point  to  test  whether 
physical  viewpoints  should  not  be  considered  more  even  in  the  selection, 
of  the  fundamental  concepts  and  of  the  switching  elements,  before  we 
even  think  of  such  a  task  as  was  mentioned  above. 

We  should  therefore  like  to  investigate  whether  the  concepts  of 
Section  4  can  not  be  derived  from  simpler  and  less  numerous  one;  we 
undertake  this  investigation  with  the  following  threefold  aim: 

1)  Postulate  P2  should  be  able  to  be  verified 
more  easily  (we  have  done  this  only  for  the 
W-nodes,  and  only  sketchily  for  those); 

2)  the  simplified  concepts  should  be  patterned 
after  the  physical  concepts; 

3)  in  principle  it  should  be  possible  to  give 
a  complete  description  of  any  material  body 
by  means  of  a  C-form. 

It  stands  out  immediately  in  our  attempt  at  simplification  that  the 
node  types  U,  V,  and  S  are  each  subject  to  two  actions.  If  it  is  possi¬ 
ble  to  make  do  with  1-action  nodes,  then  we  can  drop  the  concept  of  the 
node  entirely  and  connect  locations  directly  by  means  of  actions.  With 
definitions  and  axioms  of  the  same  form  as  in  Section  4  plus  the  addi¬ 
tional  definition  that  each  node  be  subject  to  exactly  one  action,  with 
the  elimination  of  the  'node*  concept,  we  obtain,  instead  of  the  nets 
described  above,  a  new  sort  of  structure  that  we  shall  call  an  action 
net  (or  A-net ) . 

In  that  we  conceive  of  a  node  of  a  net  as  the  superimposition  of 
two  actions,  we  recognize  immediately  that  every  net  with  the  parameters 
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P  and  M  -  2  is  isomorphic  to  an  A-net  with  the  parameters  P  and  Our 
interest,  then,  will  be  in  A-nets  with  P  *  4  and  M  •  4  (at  most  four  lo¬ 
cations  participate  in  any  given  action;  any  given  location  takes  part 
in  at  most  four  actions).  The  vicinity  of  two  elements  will  mean  parti¬ 
cipation  in  a  common  action;  the  vicinity  of  two  actions  will  imply  the 
existence  of  a  common  location.  The  valuation  of  a  location  with  a  bit 
will  be  changed  in  only  one  way,  namely  by  the  execution  of  an  action. 

In  order  to  approach  the  goal  cited  we  shall  consider  in  what  way 
a  physical  magnitude  and  the  laws  according  to  which  it. varies  can  be 
expressed  by  the  distribution  of  bits  in  A-nets.  We  could  effect  this 
by  imposing  certain  restrictions  on  the  structure  of  a  net,  but  it  seems 
much  more  satisfactory  to  bring  about  a  direct  connexion  between  general 
physical  principles  (such  as  GP1  -  GP3  of  Section  3)  and  the  properties 
of  the  actions.  We  wish,  then,  to  admit  only  those  actions  that  fulfill 
the  general  principles  GP1  to  GP3  according  to  any  arbitrary  interpret¬ 
ation  thereof. 

GP1,  the  existence  of  a  quantized  magnitude,  we  have  taken  into 
consideration  even  in  the  selection  of  the  fundamental  concepts.  GP2, 
the  validity  of  a  law  of  conservation,  we  wish  to  fulfill  by  admitting 
only  conservative  actions:  an  action  will  be  called  conservative  with 
respect  to  an  object  class  i  if  the  number  of  i-objects  (i  e  {0,  l})is 
the  same  in  both  the  lefthand  member  of  an  action  and  the  righthand  mem¬ 
ber.  For  example,  T  is  conservative  with  respect  to  the  object  classes, 
whereas  W  is  not.  GP3,  the  validity  of  a  reaction  principle,  brings  with 
the  fact  that  any  observation  alters  the  observed  property.  The  only  way 
to  exclude  observation  without  alteration  is  to  admit  only  reactive  ac - 
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tiona:  an  action  will  be  called  reactive  if  all  of  the  objects  named  in 
its  description  are  different  (therefore  if  the  ’state*  of  all  partici¬ 
pating  locations  is  changed  by  the  execution  of  the  action).  For  example, 

s 

'the  actions  of  Q,  T,  and  W  are  reactive,  those  of  V  and  S  are  not. 

We  do  not  wish  to  formalize  the  construction  process  here;  we  shall 
treat  only  those  changes  of  object  structures  that  consist  in  finite  re¬ 
valuations  of  locations  by  the  execution  of  actions.  In  what  follows, 
then,  we  shall  consider  only  nonsingular  actions :  an  action  will  be 
called  singular  if  the  set  of  locations  named  in  the  lefthand  member  of 
the  action  is  different  from  the  set  of  locations  named  in  the  righthand 
member. 

A  conservative,  reactive,  nonsingular  action  will  be  called  a  (pure) 
transition.  In  an  action  net  composed  entirely  of  transitions  GP1  to  GP3 
are  fulfilled  for  all  physical  magnitudes  that  can  be  expressed  by  sets 
of  objects  of  a  particular  class  in  the  interpretation.  The  totality  of 
possible  transitions  can  easily  be  enumerated: 

01  10,  0011  1100,  000111  -*•  111000,  ••• 

or  in  an  easily  understood  ’orthography’: 

+-,  ++--,  +++-—,  ••• 

Every  possible  transition  is  contained  in  this  sequence  (no  considera¬ 
tion  is  taken  of  the  order  of  the  locations). 

It  will  be  expected  of  an  elementary  process  that  it  cover  only  a 
small  number  of  locations.  We  now  wish  to  ascertain,  if  it  exists,  the 
smallest  number  P  such  that  the  flow  of  effect  in  a  corresponding  net 
will  have  a  nontrivial  structure.  For  P  »  2  we  have  only  the  T-element 
of  Section  4,  and  it  is  easy  to  convince  oneself  that  using  this  element 
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alone  only  trivial  structures  can  be  produced. 

On  the  other  hand,  P  =  4  may  be  seen  to  be  sufficient.  Indeed  it 
may  be  seen  that  from  the  transition  X:  ++--  alone,  and  using  only  lo¬ 
cations  with  the  same  formal  properties  of  symmetry,  nets  can  be  con¬ 
structed  for  all  automata  and  Turing  machines.  We  can  make  do  with  lo¬ 
cations  with  the  following  property:  each  location  participates  in  exact¬ 
ly  two  actions  that  enable  the  revaluation  0  -*■  1  in  that  location  and  in 
exactly  two  actions  that  enable  the  revaluation  1  -►  0  in  that  location. 
This  has  as  a  consequent  that  we  can  imagine  every  event  at  a  location 
as  connected  with  the  actual  flow  of  information  (transport  0f  a  bit) : 
in  the  valuation  of  a  location  there  are  exactly  two  actions  Xj  and  X2 
that  can  introduce  an  event,  and  the  action  will  actually  enter  by  means 
of  exactly  one  of  the  actions,  so  that  the  decision  content  of  the  bits 
named  is  expressed  by  V  X^  X2.  We  can  therefore  formally  assign  to  each 
location  a  C-form  (in  CS3) : 

Cs:  #  /  V  Xx  X2  V  X3  X4  , 

and,  similarly,  to  each  X-transition  we  can  assign  a  C-form: 

Cx:  #  /  §  a  b  5  q  d 

It  is  only  with  this  formal  relation  that  we  are  provided  with  a  con¬ 
nexion  with  the  usual  concept  of  information,  and  this  relation  makes 
the  discovery  of  the  following  nets  much  easier. 

Let  us  now  examine  once  again  the  concept  of  conflict.  In  a  con¬ 
flict-free  net  every  decision  is  made  solely  on  the  basis  of  a  situation 
expressed  in  the  net;  no  bit  can,  so  to  say,  be  bom.  We  can  imagine, 
then,  that  the  bit  that  decides  a  two- action  conflict  must  be  introduced 
to  the  net  from  outside.  If  wy  assume  that  this  can  take  place  only  by 


-76- 


means  of  actions ,  then  we  must  view  a  non-conflict-free  net  as  incom¬ 
plete*  Since  a  net  that  is  capable  of  communication  is  by  its  very  nature 
incomplete,  we  shall  be  interested  primarily  in  incomplete  nets  anyhow. 

We  can  therefore  view  a  conflict-free  net  as  a  net  with  a  completely 
specified  information  supply. 

For  the  abstract  description  of  a  physical  system  the  sense  of  tem¬ 
poral  direction  is  quite  without  consequence  as  long  as  we  preserve  its 
assignment  to  the  directional  sense  of  the  flow  of  quantities  concerned. 
If  we  reverse  the  sense  of  direction  of  the  actions  of  a  net,  then 
we  effect  an  interchange  of  the  influx  and  the  efflux  of  infoimation. 

The  reversibility  of  the  '•+■'  can  not  be  just  imagined  away  for 
physical  elementary  processes.  Therefore  we  wish  to  express  with  this 
symbol  only  an  abstract  sense  of  orientation  that  makes  an  assignment  of 
temporal  sense  to  the  directional  sense  of  the  flow.  If  we  reverse  the 
in  a  conflict-free  net,  the  net  does  not  in  general  remain  con¬ 
flict-free.  The  conflicts  that  arise  indicate  exactly  those  locations 
to  which  we  must  supply  information,  thus  those  from  which  we  derived 
information  before  the  reversal  of  the  (for  example,  the  V-eleraent, 
or  the  or-gate). 

We  shall  call  an  action  net  versible  if  it  is  conflict-free  for 
both  valuations  of  the  'V.  In  a  versible  net,  therefore,  information 
can  be  neither  produced  nor  lost,  and  all  of  the  locations  of  influx  or 
efflux  are  well-defined.  We  shall  not  pursue  the  relation  between  vers¬ 
ible  A-nets  and  reversible  physical  processes  any  further  at  this  point. 

Such  simple  action  nets  are  possibly  of  value  for  the  discussion  of 
our  conceptions  of  models  of  the  fine  structure  of  matter,  for  if  we 
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admit  postulate  PI  as  a  generally  valid  physical  principle  —  and  for 
the  investigation  of  fundamentals  this  seems  to  be  quite  advantageous  — 
then  we  obtain  with  a  theory  of  action  nets  (or  of  information  flow)  a 
useful  mathematical  tool  for  the  theoretical-physical  description  of 
those  magnitudes  that  conform  to  the  requirements  mentioned  in  postulate 
P2«  This  is  especially  useful  because  it  will  render  superfluous  the  em¬ 
bedding  of  the  quantities  to  be  observed  in  a  continuum  the  properties 
of  which  can  be  selected  quite  arbitrarily  when  they  go  beyond  what  is 
observable,  indeed  properties  that  represent  an  unnecessary  burden  in 
the  realm  of  fundamental  questions. 

We  now  wish  to  convert  the  most  important  nets  of  Section  4  into 
versible  A-nets;  in  this  conversion  we  shall  use  only  the  transition  X 
and  locations  of  the  type  mentioned  above.  Since  the  nets  can  not  be 
complete  it  will  be  impossible  for  all  of  the  actions  and  locations  to 
fulfill  the  above  definitions;  we  therefore  change  the  definitions  by 
replacing  'exactly  two'  by  'at  most  two'.  The  -periphery  of  the  action 
net  comprises  all  the  locations  and  actions  that  are  incompletely  con¬ 
nected  in  the  above  sense. 

Since  M  »  4  we  can  no  longer  use  the  graphs  of  Section  4  for  the 
pictorial  representation.  We  therefore  make  the  following  conventions: 

location  with  0-bit  at  the 


o 

0 


moment  of  construction 


location  with  1-bit  at  the 


moment  of  construction 
Action  (a  b  c  d)  :  +  +  -  - 

The  pictorial  representation  of  the  two  possible  (arbitrary)  choices  of 
action  X^  is  given  in  Figure  30. 


An  action  is  represented  by  a  pair  of  directed  line  segments  bear¬ 
ing  the  same  natural  number  as  a  marker.  Different  actions  will  have 
different  markers. 

Predicate  calculus  functions  of  two  variables:  It  is  sufficient  to 
give  the  representation  of  the  eight  unanalyzable  •1:3*  functions  since 
the  Sheffer  function  is  included  among  them.  With  disjunction  we  should 
have  the  following  (with  reference  to  Figure  31):  6  is  activation; 

V  1  2  «  x;  V  3  4  •  y;  V  3  S  *  (x  V  y)  ;  ?  4  2  is  the  information  released. 
In  the  case  of  conjunction  we  should  have  the  following:  7  2  1  *  x; 

V  4  3  ■  y;  and  V  5  3  *  (x  A  y) ;  etc. 


If  it  is  always  the  case  that  both  x  and  y  must  be  interrogated,  as 
in  the  'disjunction'  example  of  Section  4,  then  some  complete  transitions 
will  appear;  in  Figure  32,  then,  we  should  have  the  following:  7  is  the 
activation ;  V  1  2  «  x;  9  3  4  *  y;  and  V  5  6  ■  (x  V  y) . 

This  arrangement  is  of  advantage  to  us  in  a  non-conflict-free  net 
only  if  the  decisions  x  and  y  require  a  'greater  time  span'  if  they  are 


r 
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activated  serially  than  if  they  are  activated  simultaneously.  (The  con¬ 
cept  of  time  span  is  meaningful  only  in  non- conflict- free  nets.)  Then, 
however,  we  can  take  the  conflict  into  the  evaluation  of  the  function 
(as  in  Section  4)  and  make  the  greatest  possible  use  of  the  time  saved. 
Further,  here  it  is  eaiy  (in  contrast  to  Section  4)  to  design  the  net 
for  arbitrarily  frequent  use.  Thus,  in  Figure  33,  we  have  the  following: 

7  is  the  activation;  V12  =  x;V34  =  y;V56=(xV  y) • (accelerated) ; 
V  12  13  is  conflict  with  x  =  y  =  1;  and  V  8  9  =  (x  =  y) .  The  net,  as  is 
noted,  also  gives  us  the  equivalence  function,  which,  of  course,  cannot 


Functions  of  Automata,  As  in  Section  4  the  alphabets  for  input  and 
output  will  have  two  elements  each,  a  and  b,  and  o  and  <2,  respectively. 
The  normal  C-forra  is  #  /  7  a  b  7  o  d.  We  now  wish  to  place  value  on  the 
reversibility  of  all  automata  (i.  e.  exchangeability  of  input  and  out¬ 
put)  ,  which  appears  only  in  exceptional  cases  in  the  usual  theory.  In 
the  following  net  representation  it  arises  quite  of  itself  that  all  in¬ 
formation  lost  to  the  automaton  must  be  released  at  a  well-defined  lo¬ 


cation.  The  communication  via  this  latent  peripheral  location  thus  sup- 
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plements  the  information  flow  in  such  a  way  that  there  is  also  a  law  of 
the  conservation  of  infornation .  This  is  generally  the  case  for  versible 
action  nets. 


Certain  questions  of  the  minimization  of  automata  can,  on  the  basis 
of  these  considerations,  be  answered  surprisingly  simply,  as  will  be 
shown  in  another  place.  Here  we  wish  to  leave  such  questions  aside.  In 
this  sense  the  generalization  to  automata  with  arbitrary  finite  alpha¬ 
bets  should  be  thought  of  as  carried  out  in  such  a  way  that  a  recoding 
(as  in  Sections  2  and  4)  into  and  out  of  {0,  1}  takes  place  by  means  of 
two  especially  simple  automata,  and  so  that  the  state-graph  of  the  'cen¬ 


tral'  automaton  is  correspondingly  modified. 

If  Q  ■  { q j,  ...,  qn }  be  a  set  of  states,  B  ■  (a,  b }  and  C  »  ic ,  d } 
the  alphabets  for  input  and  output,  then  every  automaton  is  represented 
by  a  single- valued  mapping  M  of  Q  *  B  into  Q  *  C,  There  always  exist 
alphabets  B’«  { e ,  f)  and  { g ,  fc},  a  set  R  «  {r^,  ...,  rm) ,  and  a 
one-to-one  mapping  F  of  M  x  5)  U(^  x  B’)  onto  W  »  C)U(i!  x  C')  such 
that  if  F'(C#)  ■  e  then  (FF’^F  ■  M,  where  0  <  i  <  m  <  2n.  The  following 
may  be  taken  as  an  example: 


M: 


q2  a  c  q2 
q2  b  c  q2 

q2  a 

q2b  dq2 


F: 


q2a  gr2 

q2b  hr2 
q2a  c  q2 

q2b  dq2 

r2e  cq2 
(r2  f  d  q2) 


The  efflux  of  information  is  thus  centered  on  F' ,  and  we  have  in¬ 
troduced  finitely  many  intermediate  states  r.  The  structure  of  the  auto¬ 
maton  is  expressed  by  a  permutation  of  ($Ui?)  *  {0,  1>,  and  conversely 
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every  such  permutation  represents  an  automaton. 

Now  we  have  only  to  describe  the  net  N7  and  to  identify  the  free 
peripheral  locations  a',  b' ,  o* ,  and  d '  in  accordance  with  the  permuta¬ 
tion  cited;  this  part  of  the  coupling  prescription,  the  part  that  pro¬ 
duces  a  special  automaton  from  an  N7-chain,  is  already  taken  care  of. 
The  direct  translation  of  N7  into  the  language  of  this  Section  leads  to 
a  non-versible  net  of  36  transitions.  By  observing  the  information  flow 
it  may  be  seen  at  which  locations  a  superfluous  bit-transport  takes 
place,  and  by  the  omission  of  these  locations  the  net  shown  in  Figure 
34  results,  a  net  with  only  four  interior  locations  xt  yt  z,  and  u.  By 
reflecting  N7  about  a  horizontal  we  obtain  N7".  The  total  net  has  the 
form  shown  in  Figure  35. 


(Tt)  w7-  In  the  uppexmost  net  we  new  interchange  the 

1  |  S  valuations  of  x  and  z  (at  construction) ;  the  auto- 

I  !  ; 

i  j _  raaton  is  then  in  state  and  is  ready  to  function. 

(r„)  :  Nr  : 

*TTt  The  automaton  will  work  as  long  as  the  utilized 

Figure  35  parts  of  the  automaton  function  M  form  a  one-to-one 

partial  function  of  M;  it  then  attempts  to  give  off  a  bit  V  g  ht  and  we 
must  take  precautions  that  the  C-form  /  7  g  h  a  is  fulfilled  at  the 


latent  periphery,  either  by  means  of  a  non-versible  net  (as  in  Figure  36) 


-82- 


or  by  means  of  a  versible  push-down  store.  Such  a  store  is  given,  how¬ 
ever,  by  the  net  pair  N9-N9'  by  concatenation,  and  the  existence  of  a 
versible  A-net  with  this  function  proves  at  the  same  time  the  represent- 
ability  of  the  two  halves  of  the  tape  of  a  Turing  machine.  In  order  to 
show  the  type  of  concatenation  we  specify  two  net  pairs.  Each  net  pair 
carries  two  bits  of  the  stored  information.  For  the  righthand  half-tape 
•••  E  F  E  F  E  F  we  show  the  concatenation  E  F  in  Figure  37,  that  of 
F  E  in  Figure  38. 
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The  question  of  the  technical  realization  of  the  switching  elements 
considered  is  not  to  be  discussed  here  for  the  following  reasons:  1)  The 
question  is  not  relevant  in  this  form.  The  selection  of  the  switching 
elements  was  purely  arbitrary  (cf.  Section  4) .  The  only  essential  thing 
is  adherence  to  the  communication  forms  on  the  periphery  of  arbitrarily 
composed,  connected  N-structures.  2)  The  fact  that  there  is  no  longer 
any  forced  synchronization  of  the  actions  facilitates  the  technical  in¬ 
terpretation.  The  question  does  arise  as  to  how  one  can  secure  the  in¬ 
variance  of  the  actions.  In  the  macros copic-mechanical  realm  the  question 
is  certainly  satisfactorily  soluble  (for  example  in  switching  theory,  in 
the  inscription,  movement,  and  reading  of  material  data  carriers,  and  in 
communication  between  persons  by  means  of  speech,  writing,  or  transmitted 
objects);  and  so  also  in  the  macromolecular  realm  obviously  (for  example, 
in  the  nervous  system)  and  possibly  with  complete  rigor  in  the  atomic 
domain.  In  the  field  of  electronics  the  question  has  not  been  investigat¬ 
ed  —  probably  because  one  is  accustomed  to  observing  asynchronous  pro¬ 
cesses  in  a  continuum  (at  least  for  time)  and  because  on  occasions  for 
discontinuous  observation  it  is  maintained  that  the  partitioning  of  time 
into  a  completely  ordered  set  of  individual  steps  is  always  a  meaningful 
process  that  in  no  way  limits  generality  for  all  practical  purposes.  We 
must  certainly  add  that  this  is  erroneous  in  consideration  of  Sections 
2  to  4.  It  is  therefore  necessary  to  think  through  the  question  of  the 
immediate  technical  representation  of  action  nets  in  such  a  way  that  we 
entirely  avoid  the  detour  via  the  usual  time  concept  for  automata. 

3)  The  assumption  would  seem  to  be  justified  that  the  selection  of 
switching  elements  in  Section  5  on  the  basis  of  physical  considerations 
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in  no  way  complicates  the  realization;  indeed  with  suitable  inteipreta- 
tion  it  accomodates  the  realization.  Further  discussion  of  these  questions 
must  be  left  to  the  specialists,  however. 

We  assemble  once  again  the  advantages  expected  of  this  manner  of 
looking  at  things:  1)  the  possibility  of  conflict-free  communication 
with  and  between  automata;  2)  the  independence  of  the  construction  pro¬ 
cedures  of  the  work  processes  of  automata,  and  therewith  the  unlimited 
possibility  of  extending  automata  during  their  work;  3)  the  simplifica¬ 
tion  of  the  interpretation  in  consideration  of  the  fact  that  switching 
elements  are  required  only  to  have  ’the  shortest  possible  switching 
time’  without  being  required  to  adhere  to  tolerances  in  the  switching 
time  by  the  logical  structure;  it  should  be  noted  in  that  context  that 
the  concept  of  switching  time  can  appear  only  in  those  total  nets  that 
have  at  least  one  location  of  conflict;  4)  the  conflict-free  coupling 
of  processes  running  simultaneously;  5)  the  displacement  of  noneliminable 
conflicts  to  locations  where  we  can  derive  benefit  from  their  existence 
(as  in  the  or-gate) . 

We  return  now  to  the  previously-mentioned  (Section  1)  application 
to  questions  of  programming.  This  possibility  of  application  is  so  ob¬ 
vious  that  we  need  only  allude  to  the  conceptual  similarity  of  the  sys¬ 
tems  that  have  been  illustrated  to  the  conventional  flow  chart.  Once 
again  it  is  the  unconventional  treatment  of  temporal  dependencies  that 
allows  us  a  completely  explicit  representation  of  the  flow  of  effect 
and  therefore  a  rigorously  formal  treatment  of  communication  with  con¬ 
sideration  of  the  physical  possibilities.  The  important  role  of  the 
parallelity  operator  has  already  been  discussed  in  Section  4.  Its  intro- 
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duct  ion  can  be  explained  as  the  renunciation  and  replacement  of  a  uni¬ 
versal  (and,  therefore,  usually  unmentioned)  paralleiity  operator  that 
is  obligatory  for  each  step  in  time  and  connects  all  processes  in  two 
successive  time  steps;  its  replacement  is  effected  by  a  uniformly  limit¬ 
ed  connexion  that  is  to  be  specified  explicitly.  It  is  clear  that  this 
has  a  far-reaching  influence  on  the  description  of  organizational  com¬ 
positions. 

Without  such  an  operator  no  meaningful  interpretable  formalization 
of  irregular  communication  processes  is  possible.  Even  beyond  this  the 
concept  of  conflict  allows  a  formally  exact,  finite  representation  of 
such  expressions  as  'NA  is  trying  to  solve  the  problem  ',  and  this  re¬ 
presentation  is  independent  of  any  statement  of  the  content  or  the 
structure  of  the  problem  B,  The  conflict  concept  further  yields  a  re¬ 
presentation  of  the  gams  and  allows  a  distinct  separation  of  the  vari¬ 
ous  concepts  of  probability ;  this  separation  is  accomplished  by  means 
of  the  explicit  specification  of  nets  that  fulfill  the  prescriptions 
(C- forms)  for  communication  for  the  purpose  of  'ascertaining  a  probab¬ 
ility'.  By  this  we  mean  a  plan  for  the  derivation  of  decisions  V  x  y 
from  a  probability  judgement;  such  judgements  are  to  be  had  as  output 
from  nets  whose  freedom  from  conflict  is  not  proven. 

In  this  way  certain  very  simple  principles  of  organization  invade 
the  domain  of  activity  designated  here  as  programming,  concepts  that 
are  beyond  the  reach  of  ordinary  'time-step  programming'  as  a  matter  of 
principle.  This  is  of  interest  because  of  the  growing  complexity  of  the 
tasks  that  are  to  be  given  to  information-processing  machines;  with  ir¬ 
regular  tasks  there  is  the  danger  that  the  user  of  the  machine  will  no 
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longer  be  capable  of  overseeing  the  set  of  conventions  that  must  be  ad¬ 
hered  to.  Since  all  irregular  parts  of  the  problems  must,  however,  be 
mapped  onto  such  conventions,  even  if  an  automaton  were  to  take  over  a 
partial  plan  of  the  user  this  would  represent  only  a  comparatively  tri¬ 
vial  lightening  of  the  user's  job  if  the  partial  plan  is  expressible  in 
time-step  programming. 

In  this  sense,  then,  the  problem  of  automation  (or  automaticization) 
ought  to  be  viewed  to  a  greater  degree  as  a  problem  of  communication.  The 
mathematico-logical  treatment  of  this  problem  can,  so  it  is  to  be  hoped, 
be  eased  by  the  development  of  an  interpreted  calculus  of  C-forms.  The 
nets  illustrated  in  this  work  were  found  in  an  approach  to  this  develop¬ 
ment;  further,  such  approaches  have  also  yielded  valuable  suggestions 
for  the  translation  of  formal  languages  such  as  ALGOL.  Therefore,  we 
should  like  to  return  to  this  calculus  once  again. 

In  a  way  analogous  to  the  transition  from  CS1  to  CS2  we  generalize 
CS3  to  CS4  with  the  two-place  operators  7,  /,  and  6  and  the  zero-place 
operator  R.  For  convenience  we  also  admit  operators  derivable  from  these, 
such  as  *  and  a  cycle-operator  Z: 

#acVa/aR;  2  ais  7a  /  /  aH  . 

An  R  in  the  second  member  of  a  V- formula  leads,  as  in  CS2,  to  a  recur¬ 
sion.  By  means  of  R  we  can  express  the  activation  of  a  constructor.  The 
interpretation  of  R  has  not  yet  been  investigated  sufficiently.  It  is 
surmised  that  with  the  aid  of  CS4  formulas  and  a  suitably  defined  and 
interpreted  c -relation  between  them  all  of  the  elementary  aspects  of 
communication  can  be  satisfactorily  represented.  The  conjecture  could 
be  supported  quite  strongly  by  a  pair  of  theorems  analogous  to  T1  and  T2. 
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A  corresponding  formal  proof  is  possible  for  certain  action  nets,  but 
because  of  certain  difficulties  of  interpretation  that  have  not  yet 
been  put  to  rest  this  proof  will  not  be  reproduced  here. 

In  other  words,  there  is  yet  lacking  a  sufficient  characterization 
of  the  class  of  generalized  automata  for  which  a  pair  of  theorems  like 
T1  and  T2  (but  with  CS4  instead  of  CS1)  is  valid.  On  the  other  hand, 
the  author  hopes,  vrith  this  work,  to  have  contributed  to  the  clarifica¬ 
tion  of  the  conceptual  foundations  of  a  theory  of  communication. 


o  0  o 


-8ft. 


Selected  Bibliography 

[1]  Bottenbruch,  H.,  Uebersetzung  algorithmischer  Fomelsprachen  in 

die  Programspraahe  ftlr  Turlngmaschinen .  Dissertation* 
Darmstadt,  1957. 

[2]  Burks,  A.  W. ,  Computation,  behavior  and  structure  in  fixed  and 

growing  automata,  in  Self-Organizing  Systems ,  Papers  of  the 
Interdisciplinary  Conference  on  Self-Organizing  Systems, 
Chicago,  1959  (M.  C.  Yovits,  ed.),  pp.  282-311.  New  York, 

1960. 

[3]  Burks,  A.  W.  and  Wang,  H.,  The  logic  of  automata.  Journal  of  the 

Association  for  Computing  Machinery  4,  193-218  and  279-29  7 
(1957) . 

[4]  Burks,  A.  W.  and  Wright,  J.  B.,  Theory  of  logical  nets.  Proceedings 

IRE  41,  1357-1365  (1953);  reprinted  in  Moore  [17]  pp.  193-212. 

[5]  Carnap,  R.,  Logical  Foundations  of  Probability ,  Chicago,  1950. 

[6]  Carnap,  R. ,  Introduction  to  Symbolic  Logic  and  Its  Applications 

(trans.  by  W.  H.  Meyer  and  J.  Wilkinson).  New  York,  1958. 

[7]  Chomsky,  N.,  Formal  properties  of  grammars,  in  Handbook  of  Mathe¬ 

matical  Psychology t  Volume  II  (Luce,  Bush,  and  Galanter,  eds.), 
pp.  323-418.  New  York,  1963, 

[8]  Copi,  I.  M. ,  Elgot,  C.,  and  Wright,  J.  B.,  Realization  of  events 

by  logical  nets,  Journal  of  the  Association  for  Computing 
Machinery  5,  181-196;  reprinted  in  Moore  [17]  pp.  175-192. 
(1958). 

[9]  Curry,  H.  B.  and  Feys,  R.,  Combinatory  Logic .  Amsterdam,  1958. 

[10]  Davis,  M.  D.,  Computability  and  Unsolvability .  New  York,  1958. 

[11]  Kleene,  S.  C.,  Representation  of  events  in  nerve  nets  and  finite 

automata,  in  Automata  Studies  (C.  E,  Shannon  and  J,  McCarthy, 
eds.),  pp.  3-42.  Princeton,  1956. 

[12]  Lee,  C.  Y.,  Automata  and  finite  automata,  Bell  System  Technical 

Journal  39,  1267-1295  (1960). 

[13]  McCarthy,  J.,  Recursive  functions  of  symbolic  expressions  and  their 

computation  by  machine.  Communications  of  the  Association  for 
Computing  Machinery  3,  184-195  (1960), 

[14]  McNaughton,  R.  and  Yamada,  H.,  Regular  expressions  and  state  graphs 

for  automata,  IRE  Transactions  on  Electronic  Computers  EC-9, 


-89- 


39-57  (I960);  reprinted  in  Moore  [17]  pp.  157-174. 

[15]  Mealy,  G.  H. ,  A  method  for  synthesizing  sequential  circuits.  Bell 

System  Technical  Journal  34,  1045-1079  (1955) ;  reprinted  in 
Moore  [17]  pp.  157-174. 

[16]  Moore,  E.  F.,  Gedanken  experiments  on  sequential  machines,  in 

Automata  Studies  (C.  E.  Shannon  and  J.  McCarthy,  eds.), 
pp.  129-153.  Princeton,  1956. 

[17]  Moore,  E.  F.,  Sequential  Machines:  Selected  Papers,  Reading,  Mass., 

1964. 

[18]  Muller,  D.  E.  and  Bartky,  W.  S.,  A  theory  of  asynchronous  circuits, 

in  Proceedings  of  an  International  Symposium  on  the  Theory  of 
Switching,  Harvard  University,  April  1957,  Annals  No,  29  of 
the  Computation  Laboratory  of  Harvard  University,  Cambridge, 
Mass.,  1959. 

[19]  Post,  E.  L.,  Finite  combinatory  processes  —  Formulation  I,  Journal 

of  Symbolic  Logic  1,  103-105  (1936). 

[20]  Rapoport,  A.,  Operational  Philosophy,  New  York,  1953. 

[21] 

IBM  Journal  of  Research  and  Development  4,  208ff,  (1960). 


Security  Classification 


> 


i 


DOCUMENT  CONTROL  DATA  •  RAD 

(Security  claeeihcetion  ol  title  bocfy  o I  sbatrsct  end  indexing  annotation  mutt  be  entered  tvfcan  the  overall  report  is  desalted) 
I  ORIOINATIN  G  ACTIVITY  (Corporate  author) 

Dr.  Carl  Adam  Petri 
Bonn  University,  Germany 

3  REPORT  TITLE 

Communic°tion  with  Automata 


4  DESCRIPTIVE  NOTES  (Type  ol  teporl  end  Inclusive  dates ) 


Supplement  I  to  R^DC-'T,R-(cit5-.377,  Volume  I 


5  AUTHORfSJ  (Lest  name.  Ilrst  name,  Initial) 

Dr.  Carl  Adam  Petri 

# 

6  REPORT  DATE 

7a-  total  no  of  paoes 

76.  NO.  OF  REFS 

January  19 66 

89 

21 

Q«  CONTRACT  OR  GRANT  NO.  ^^0(^02)  3^2^ 

b.  PROJECT  NO- 

fa.  ORIGINATOR* »  REPORT  NUMBERfS) 

c 

ffe.  OTHER  REPORT  NO (S)  (A  ny  other  numbere  that  mey  be  aeelgned 
thle  report) 

d 

RADC -TR-63-377 ,  Vol.  I  (Final  Report^ 

10  A  VA  IL  ABILITY/LIMITATION  NOTICE* 

Distribution  of  this  document  is  unlimited. 

11  SUPPLEMENTARY  NOTES 

12-  SPONSORING  MILITARY  ACTIVITY 

RADC ,  GAFB .  NY  1^0 

13  abstract  rj^g  theory  of  automata  is  shown  not  capable  of  representing  the  actual 
physical  flow  of  information  in  the  solution  of  a  recursive  nroble™. 

*11  of  the  re«lly  usef”l  results  of  automata  theory  may  be  expressed  by 
m-ans  of  these  new  concepts.  Moreover,  the  results  retain  their  usefulness  and 
the  new  procedure  has  definite  advantages  over  the  older  ones. 

The  proposed  representation  differs  from  each  of  the  presently  known 
theories  concerning  information  on  Bt  le°st  one  of  the  following  essential 
nolnts: 

1.  Hie  existence  of  a  metric  is  assumed  for  neither  space  nor  time  nor  for 
other  nhysiccl  magnitudes. 

2.  Time  is  introduced  as  a  strictly  loc-’l  relation  between  states. 

3.  The  objects  of  the  theory  are  discrete,  and  thev  are  combined  and  nro- 
duced  only  by  means  of  strictly  finite  techniques. 

The  following  conclusions  drawn  from  the  results  of  this  work  nry  be  cited 
as  of  some  practical  interest: 

1.  The  tolerance  renuirements  for  the  response  characteristics  of  computer 
components  can  be  substantially  weakened  if  the  computer  is  suitable  structured 

2.  It  is  possible  to  design  computers  structurally  In  such  a  way  that  the; 
are  asynchronous,  all  parts  operating  in  parallel,  and  can  be  extended  arbitrar: 
without  interrupting  their  computation. 

3.  For  complicated  organizational  processes  of  any  given  sort  the  theory 
yields  «  m*ans  of  representation  that  with  equal  rigor  and  simplicity  accom¬ 
plishes  more,  than  the  theory  of  synchronous  automata. 

DD  1473 


2*.  RCPORT SECURITY  CLASSIFICATION 

Unclassified 

26  CROUP 


iy 


Security  Classification 


Security  Classification 


CoT"P’’t*»rs 

Theory 

Dat°  Processing  Systems 


INSTRUCTIONS 


1.  ORIGINATING  ACTIVITY  Enter  the  name  and  address 
of  the  .  ontraetor,  subcontractor,  grantee.  Department  of  De¬ 
fense  activity  or  other  organization  (corporate  author)  issuing 
(he  report. 

.!/..  REPORT  SECURITY  CLASSIFICATION:  Enter  the  over- 
•ill  security  classification  of  the  report.  Indicate  whether 
“Restricted  Data"  is  included.  Marking  is  to  be  in  accord- 
<ime  with  appropriate  security  regulations. 

GROUP:  Automatic  downgrading  is  specified  in  DoD  Di¬ 
rective  S200. 10  and  Armed  Forces  Industrial  Manual.  Enter 
the  gr  nip  number.  Also,  when  applicable,  show  that  optional 
markings  have  been  used  for  Group  3  and  Group  4  as  author¬ 
ized 

).  REPORT  TITLE:  Enter  the  complete  report  title  in  all 
<  apitnl  letters.  Titles  in  all  cases  should  be  unclassified. 

If  a  meaningful  title  cannot  be  selected  without  classifica¬ 
tion,  show  title  classification  in  all  capitals  in  parenthesis 
immediately  following  the  title. 

■1.  DESCRIPTIVE  NOTES:  If  appropriate,  enter  the  type  of 
report,  e.g. ,  interim,  progress,  summary,  annual,  or  final. 

Give  the  inclusive  dates  when  a  specific  reporting  period  is 
i  overed. 

S.  AUTHOR(S):  Enter  the  name(s)  of  authorfs)  aa  shown  on 
or  in  the  report.  Entet  last  name,  first  name,  middle  initial. 

If  military,  show  rank  and  branch  of  service.  The  name  of 
the  principal  ..  <thor  is  an  absolute  minimum  requirement. 

h.  REPORT  DATE:  Enter  the  date  of  the  report  as  day, 
month,  year,  or  month,  year.  If  more  than  one  date  appears 
on  the  report,  use  date  of  publication. 

7.1.  TOTAL  NUMBER  OF  PAGES:  The  total  page  count 
should  follow  normal  pagination  procedures,  l.e.,  enter  the 
number  of  pages  containing  information 

76  NUMBER  OF  REFERENCES:  Enter  the  total  number  of 
references  cited  ui  the  report. 

8a.  CONTRACT  OR  GRANT  NUMBER:  If  appropriate,  enter 
the  applicable  number  of  the  contract  or  grant  under  which 
the  report  was  written 

86,  8c,  Ik  8d.  PROJECT  NUMBER:  Enter  the  appropriate 
military  department  identification,  such  as  project  number, 
subproject  number,  system  numbers,  task  number,  etc. 

9a.  ORIGINATOR’S  REPORT  NUMBER(S):  Enter  the  offi¬ 
cial  report  number  by  which  the  document  will  be  identified 
and  controlled  by  the  originating  activity.  This  number  must 
be  unique  to 'this  report. 

96.  OTHER  REPORT  NUMBER(S):  If  the  report  has  been 
assigned  any  other  report  numbers  (either  by  the  originator 
or  by  the  sponsor),  also  enter  this  number(s). 

10.  AVAILABILITY/LIMITATION  NOTICES:  Enter  any  lim¬ 
itations  on  further  dissemination  of  the  report,  other  than  those 


imposed  by  security  i lassificition,  using  standard  statements 
such  as: 

(1)  “Qualified  requesters  may  obtain  copies  of  this 
report  from  DDC." 

(2)  “Foreign  announcement  and  dissemination  of  this 
report  by  DDC  is  not  authorized.  ” 

(3)  “U.  S.  Government  agencies  may  obtain  copies  of 
this  report  directly  from  DDC.  Other  qualified  DDC 
users  shall  request  through 


(4)  "U.  S.  military  agencies  may  obtain  copies  of  this 

report  directly  from  DDC.  Other  qualified  users 
shall  request  through 


"All  distribution  of  this  report  is  controlled.  Qual¬ 
ified  DDC  users  shall  request  through 


If  the  report  has  been  furnished  to  the  Office  of  Technical 
Services,  Department  of  Commerce,  for  sale  to  the  public,  indi¬ 
cate  this  fact  and  enter  the  price,  if  known. 

11.  SUPPLEMENTARY  NOTES:  Use  for  additional  explana¬ 
tory  notes. 

12.  SPONSORING  MILITARY  ACTIVITY:  Enter  the  name  of 
the  departmental  project  office  or  laboratory  sponsoring  (pay¬ 
ing  (or)  the  research  and  development.  Include  address. 

13  ABSTRACT:  Enter  an  abstract  giving  a  brief  and  factual 
summary  of  the  document  indicative  of  the  report,  even  though 
it  may  also  appear  elsewhere  in  the  body  of  the  technical  re¬ 
port.  If  additional  space  is  required,  a  continuation  sheet  shall 
be  attached. 

It  is  highly  desirable  that  the  abstract  of  classified  reports 
be  unclassified.  Each  paragraph  of  the  abstract  shall  end  with 
an  indication  of  the  military  security  classification  of  the  in 
formation  in  the  paragraph,  represented  as  (TS).  (S).  (C).  or  (V) 

There  is  no  limitation  on  the  length  of  the  abstract.  How¬ 
ever,  the  suggested  length  is  from  150  to  225  words. 

14.  KEY  WORDS:  Key  words  are  technically  meaningful  terms 
or  short  phrases  that  characterize  a  report  and  may  be  used  as 
index  entries  for  cataloging  the  report.  Key  words  must  be 
■elected  so  that  no  security  classification  is  required.  Identi¬ 
fiers,  such  aa  equipment  model  designation,  trade  name,  military 
project  code  name,  geographic  location,  may  be  used  as  key 
words  but  will  be  followed  by  an  indication  of  technical  con¬ 
text.  The  assignment  of  links,  rules,  and  weights  is  optional. 


Security  Classification 


